This blank page was inserted to preserve pagination. 



...I.., i| i 1 iluijiW!! .". Jji I. .'..i. J..',.JllUj)UMfcWII!^ ' . ..'. ! ' '.!, 'P'W 



1 



MAC TR-110 



COMPLEXITY CLASSES OF RECURSIVE FUNCTIONS 



Robert Moll 



June 19*73 



This research was supported in part by 
the National Science Foundation under 
research grant GJ-34671, and in part 
by the Advanced Research Projects Agency 
of the Department of Defense under ARPA 
Order Ho. 433 which was Monitored by 
ONR Contract No. NaO014-70-A-O3«2-00Ol. 



MASSACHUSETTS INSTITUTE QfL TECHNOLOGY 
PROJECT MAC 

CAMBRIDGE MASSACHUSETTS 02139 



-2- 



Abs tract 



An honest function is one whose size honestly reflects its computation 
time. In 1969 Meyer and McCreight proved the "honesty theorem", which says 
that for every t, the t-computable functions are the same as the t'-compu- 



Ways of constructing honest functions are considered in detail. It is 
shown that for any t there is an honest t' such that the t-computable 
functions and the t' -computable functions are the same, and such that t' 
is arbitrarily large on a dense set of arguments. Moreover any construction 
method satisfying certain natural criteria will (almost) have this property. 

On the other hand it is shown that by relaxing these criteria we 
can guarantee that t' ^ t on a (weak) dense set. We can also guarantee 
that t' will be bounded above by a predetermined recursive function on all 
but finitely many arguments. Finally, we show that in the case where t 
is monotone, t' can also be made monotone. 

We consider the t-computable functions, and order these classes under 
set inclusion as t varies over the recursive functions. We show that given 
any total effective operator F and any recursive countable partial order R 

there is an r.e. sequence of machine running times T„, T_, ••• T , ••• 

1 n 

such that if iRj , then the T. computable functions properly contain the 

F(T.) computable functions, and if i and j are incomparable, then F(T.) > T. 

~ i ~ i j 

infinitely often and F(T.) > T. infinitely often. 

~ j i 
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Preface 

The three chapters of this thesis can be read independently. 
Chapters two and three are entirely self-contained; no attempt has 
been made to integrate them into a single document. Chapter two 
has been accepted for publication by the Journal of Symbolic Logic . 
It is co-authored by Albert R. Meyer. Chapter three has been 
submitted for publication to the Journal of Computer and System Sciences. 
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Chapter 1 

A Survey of Work on Subrecursive Hierarchies and Subrecursive Degrees 

The definition of the partial recursive functions is easily describable, 
involving merely the (i-operator in addition to the traditional initial 
functions and schemas for developing the primitive recursive functions. 
Moreover the Kleene normal form theorem gives an effective syntactic 
presentation of these functions. The recursive functions, those partial 
recursive functions which are total, has no such presentation. In general 
the demonstration that a partial recursive function is total involves a non- 
constructive existence proof. 

To avoid this difficulty, subrecursive hierarchies have been con*- 
s true ted in an attempt to effectively approximate the class of recursive 
functions. 

A subrecursive hierarchy is a sequence of classes of recursive functions 
P n , P., •••, P , •••, P Q , •••, where a and may be finite or infinite 

O i- Qt p 

ordinals. For a < 0, P 5 P R , and the extension of a hierarchy from a 

to or*-l, or from (a } „„ to a (where lim a = a and a is limit ordinal) is 
1 n neN n n 

usually carried out by some uniform effective principle. 

The method of hierarchies has also been applied to certain rich and 
interesting subclasses of the recursive functions. The goal of such 
hierarchies is to approximate the given class from below with smaller, more 
comprehensible sets of functions. Hopefully such a construction will 
provide insight into the structure and complexity of the given class. 
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We begin by studying w-length hierarchies of the primitive recursive 
functions. We show that these hierarchies are quite successful in that 
they give non-trivial alternative formulations of the primitive recursive 
functions. Moreover there is considerable agreement among the various 
hierarchies, and this agreement may be interpreted to mean that various 
notions of primitive recursive complexity coincide. 

Similar results are obtained for co-hierarchies of the elementary 
functions. 

Next we consider various attempts to build hierarchies of transfinite 
length which exhaust the recursive functions. We discuss at length the 
issue of names for ordinals. Ordinal names must be used to index any trans- 
finite hierarchy, and we show how problems with ordinal names has essentially 
ruled out any hope of building a meaningful exhaustive hierarchy of the 
recursive functions. 

The difficulties with building exhaustive hierarchies has led investi- 
gators to construct and study "short" transfinite hierarchies which exhaust 
only a portion of the recursive functions. A key issue for such construc- 
tions is the selection of "nice" ordinal names to index such hierarchies, 
and this has been done with considerable success, at least for hierarchies 
of length less than or equal to 8 . 

Finally, we consider subrecursive degrees, corresponding to Turing 
degrees of full recursion theory. This recently revitalized area has begun 
to distinguish itself from the theory of Turing degrees, and has established 
some interesting structural results about subrecursive behavior. 
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Notations and Definitions 

For basic notation from recursive function theory, we follow Rogers [2 ]. 

We denote by < x,y > a 1-1 onto recursive map from NxS^N. Associated 
with < > are decoding functions TT r tt 2§ such that z = < tt^z) , Tr 2 (z) >. 

Let f be any function. Define f (1) (x) = f(x), f^V) = f(f n (x)). 

f ^ n ' is the n -power of f . 

If t is any total function, then the t-computable functions are the 
set of functions computable within t(x) Turing machine steps, for all but 
finitely many arguments. Our Turing machine conventions are those of 
Davis [ ] . 

if f ( x , .... x n > = h ( g (x , .... y.— . v ( v -' \» we 8ay 

that f is defined from h, g Q , •••, g^ by composition. 
If f(0, x lf .'., x n ) = g(x 1 , •••, x n ), 

f(n+l, x r .-., x n ) = h(f(n, x v ••-, x n ), n, x^ ■••, x n ) , 

then we say that f is defined from g and h by primitive recursion. 

The class of primitive recursive functions is the smallest class of 
functions containing the zero function, the successor function, and the 
projection functions U n (x r —, « n ) - x ±f which is closed under composition 
and primitive recursion. 

If g, h, and j belong to some class of functions and f satisfies the 

equations 

f(0,y) = g(y), 

f(x+l, y) = h(x, y, f(x,y)) 

f(x,y) * j(x,y), 
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then we say that f is defined by limited recursion from g, h, and j. 

n 
If f(n, x, ••• x ) = II g(z, x 1 , •••, x k ), we say f is defined from 

z=0 

g by limited multiplication. There is a similar scheme for limited summation. 

If f(x , •••, x ) = g(y t , •••, y ), where each y equals some x^ then 
we say that f is defined from g by explicit transformation. 

The class of elementary functions E of Kalmar [77] can be defined as 
the smallest class containing x+y, x«y, and x which is closed under the 
operations of composition, explicit transformations, and limited recursion. 

We use xl as an abbreviation for the expression x-, x , •••, x . 

Section 1 . co-hierarchies of Primitive Recursive Functions 

The primitive recursive functions have been the most widely studied 
subrecursive class, and so it is natural that much of the work on hierarchies 
of recursive functions has centered around classifying these functions. An 
oj-hierarchy of primitive recursive functions is an increasing sequence of 
classes of functions P , P^ •••, P , •••, such that for each k, P fc ^ P k+1 
and such that the union of these classes equals the primitive recursive 
functions. If f is primitive recursive, then the least k such that f e P^ 
in some sense measures the difficulty of f. As we shall see there are 
many different ways to formulate hierarchies of primitive recursive 
functions, each with its associated concept of difficulty; however, there 
is a high degree of invariance among these concepts, and this invariance 
makes the primitive recursive functions a well understood subrecursive class. 
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Primitive recursive hierarchies have been formulated in several different 
ways. One approach is to consider each class in the hierarchy as a closure 
class. Each P, is formed by the application of certain sub-primitive 
recursive closure rules to certain initial functions, usually differing only 
in a single "key" function f . This is the approach of Gzregorsyk, and 
Axt. Another formulation constructs each class using some external 
syntactic criterion; for example, one might assign f to P. if f can be 
defined using at most n nested instances of primitive recursion. Axt 
did the initial work in this direction. Yet another approach, proposed by 
Robert Ritchie, Robbin, Cobham, and Meyer and Ritchie, is complexity- 
theoretic in nature, f e P, in case f is (roughly) f, computable. 

The fundamental result of this section is that all these approaches 
yield essentially the same hierarchy. 

Gzregorcayk in his 1953 paper [41] gives the first formulation of an 
u-hierarchy of primitive recursive functions. He defines a sequence of 
rapidly increasing recursive functions f , and each £ is used to define 
the n class in the sequence. 
Definition : Define a sequence of functions f e ft, as follows: 



2 



1. f (x,y) = y+1 

2. f x (x,y) = x+y 

3. f 2 (x,y) = (*+!)• (y+1) 

4. f^Co.y) = f n (y+i, y+i) 

5. f^OH-i.y) = ^(x , f^x.y)) 
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He defines his sequence of classes of primitive recursive functions 

ii , Ji , ••', E 5 ... 9 as follows. 

Definition: Let E be the smallest class of functions containing as initial 

functions the successor function, the projection functions, and f , and 

n 

closed under the operations of composition, explicit transformation, and 
limited recursion. 

Notice that f^ is essentially exponentiation, and so E is the elem- 
entary functions. 

An essential feature of any proposed hierarchy is a hierarchy theorem, 
that is, a theorem which demonstrates that the classes of the hierarchy form 
a proper increasing chain. 
Theorem : For all n £ e\ e" 4 " 1 . 

Gzregorczyk's proof of this theorem is complicated by his choice of 

key functions f . The difficulty in the proof arises because f , is not 
K n+1 

defined by a simple primitive recursive scheme, and so a bounded recursion 

argument by itself will not suffice to establish the result. Gzregorczyk 

uses a fairly intricate coding argument to show that for i < n, f e E n - 

i ' 

this shows that E n <z E™ for each n. 

The proof that each containment is proper follows from the fact that 
for each n, f n+1 (x,x) majorizes the one-variable functions of E n . 

By first observing that each f is primitive recursive, it is immediate 
that U E c primitive recursive functions. The next result shows that 
this containment is actually an equality. 
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Theorem: (J E = primitive recursive functions. 
n 

To prove this Gzregorczyk uses a formulation of the primitive recur- 
sive functions due to R.M. Robinson [78]. The important feature of this 
formulation is that primitive recursion is eliminated and is replaced by 
a schema for iteration. It is then not difficult to show by induction on 
the order of a function (where the order of f counts the number of opera- 
tions used in the definition of f ) that if f is primitive recursive and has 

k+3 
order k, then f e E 

In an early paper Cobham [79], drawing on work of Ritchie [66], 

k 
considers the Gzregorczyk hierarchy and observes that the classes E have 

interesting complexity- theoretic properties. 

k k 

Theorem : For k 2 3 f e E if f some program P computes f and T e E , where 

k 
T is the run- time of P if f there is a g s E such that f is g-computable. 

P 

Cobham states his result for k ^ 3 to achieve machine- independence; 

in this form the theorem is true for any device or programming language 
which can be arithmetized in an elementary-recursive way. 

Meyer and Ritchie [72] exploit this result to give a complexity- 
theoretic formulation of the Gzregorczyk hierarchy. We develop the Meyer- 
Ritchie approach here because the ideas involved will be useful in proving 
the equivalence Of various different hierarchies. 
Definition : Given any f, let E(f), the functions elementary in f , be the 
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smallest set containing x , x+y, x«y, and f, which is closed under composi- 



tion, explicit transformation, and limited recursion 

F, ) = E , where f, 
k k 



k th 

Notice that for k ^ 3 E(f ) = E , where f is the k Gzregorczyk 



function. 

The following simple theorem proves one part of Cobham's result cited 
above. 

Theorem : Let g be any function computable within t(x) steps for each 

argument x. If t £ E(f), then g e E(f). 

The proof of this theorem rests on the fact that in any reasonable 

machine model there exist elementary functions (e, x , y) for m > 1 such 

m m 

that (e, x , y) = the output of the e Turing machine on arguments x , 

mm ^* ° xn 

if the machine halts within y steps, and otherwise. For every f, 

£ E(f), and so (e , x , t(x )) = g e E(f), where e is a machine 
m m g m m ' g 

which computes g in time t. 

Call a function f elementary - honest if f is h-honest for some elem- 

+ 
entary-recursive h. The next result is a partial converse to the last 

theorem. 

Theorem : If f is elementary-honest and if g e E(f), then there is a 

t £ E(f) such that g is t-computable. 

Summarizing these last two results we have that if f is elementary 

honest, then g e E(f) if and only if g is t-computable for some t £ E(f). 

Classes with this property are called computation - time closed classes. 



t 
See definition 1 of Chapter 2, Section 2. 
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The size of functions in E for each k plays an important role in 
Gzregorczyk' s work. The following simple bounding lemma of Meyer and 
Ritchie will yield more precise information on function size for 
Gzregorczyk' s classes. 

Bounding lemma : If f is non-decreasing and £ 2 and if g e E(f), then there 

r— (c) 
is a constant c such that g(x ) ^ f (maxTx-, •••. x ]). 

n — ~ " l n 

Meyer and Ritchie are now in a position to redefine the Gzregorczyk 
classes. First they note that fog is elementary honest if f and g are, and 

f is at least as large as the identity. Similarly if f is elementary honest 

(c) 
and non-decreasing, then f is elementary honest. Using these observations 

they construct a Gzregorezyk-like sequence of elementary honest functions 

g , (based on a modification of Gzregorczyk 's functions due to Ritchie [67D. 

as follows: 

x 

g 3 - 2 - ■ 



These simple functions can be used instead of Gzregorczyk* s functions 
f. , so that for n ^ 3, E = E(g ')• Thus for n 2s 3 the class E is precisely 

K XI 

the set of functions which are computable within time bounded by some 

fixed iterate of g . 
°n 

Gzregorczyk has one other result of interest, and this result leads 
very naturally to another formulation of a primitive recursive hierarchy. 
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Definition : Let E be a class of functions. A function F(x,y) is a univ- 
ersal function for E if for each x, \y F(x,y) e E, and for every g e E there 
is an x such that g = \y F(x,y). 

Theorem : For n <: 2 E contains a universal function for the one-variable 
functions in E . 

An important feature of any hierarchy is the method used for class 
enlargement, the "jump operation" of the hierarchy. One of the weaknesses 
of Gzregorczyk' s formulation is the obscurity of his jump operation, and 
the resulting relative difficulty of his hierarchy theorem. 

Axt [13] proposes an u)-hierarchy where the jump operation is based 

explicitly on universal functions. To go from class to P. to class P . 

k k+1 

Axt adds to the initial functions of P an enumerating function for P . 

k k 

Definition : Let 8 be a set of total functions. We say a function is 

4 
E_ in 6 if belongs to the smallest class containing 9 and f, (the 

Gzregorczyk function f , ) , which is closed under composition, explicit 

transformation, and limited recursion. 

Axt now chooses a particular E function ef(x,y) such that ef (x,y) 

is a universal function for the set of functions E in 9. 

Definition : Define e for n s as follows: 

n 

e Q (x,y) = 

e 
e n+ l (x ' y) = ef n(x ' y) 



ns 
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Axt now defines classes E based on the enumerating functions e ; E 

n n n 

4 
will be the set of functions E in e . 

n 

Theorem (Axt Hierarchy Theorem): E 5 E q • • • 5 E • 

Notice that the proof of this theorem is immediate, since E -. contai 

the initial functions for E , and by a trivial diagonization, e , n t- E . 

n n+i n 

Axt is able to show his hierarchy is essentially the same as 

Gzregorczyk' s. 

Theorem: For all n s E = E . 
n 

This is a pleasing result. It gives us a surprising alternative for- 
mulation of the Gzregorczyk hierarchy. However, Axt's result is less 
significant than one might suspect. The difficulty with his work lies 
with his choice of the universal function ef. It is not hard to show that 
there are a great many possible universal functions ef, each as natural as 
Axt's ef, and each yielding a different hierarchy when used as a jump 
procedure to construct an Axt-like hierarchy. Indeed, the significance 
of his technique is the highly non-invariant character of his jump operation. 
This phenomenon is in sharp contrast to the situation in full recursion 
theory, where the behavior of the jump operation on Turing degrees does not 
depend on the specific details of the jump definition. 

Axt formulates another w-hierarchy in [14] based on a natural syntactic 

criterion, depth of nesting of primitive recursion. He defines his classes 

K as follows, 
n 



■ 18- 



DefiTiition : 

(i) if f is an initial function, that is if f is the eero function, 

the successor function, or a projection function, then f e K . 

(ii) if f is defined by composition from h, g.. , •••, g , and h e K. , 

i k i Q 

g n e K. , •••, g e K. , then f e K r . i „ 
1 i x k i' max[i. | Os j < k] 

(iii) if f comes from g and h by primitive recursion and g e K anc j 

V 
h e K , then f e K- 

n„ i+maxLn- , n J 

It is immediate that K„ C K, • • • cz K C • • • and the [J K = primitive 

? 1 j tl ? nn r 

recursive functions. 

This hierarchy uses no external machinery in its definition, and in 
this sense is perhaps the most naturally formulated hierarchy of any we 

__i -I J* 

have considered. It turns out that f or n £ 3 E = K , although Axt 
was unable to show this in his original study. 

Meyer [80] was the first to show that Axt's depth of nesting hierarchy 

and the Gzregorczyk hierarchy eventually coincide. He shows that for 

n+1 
n^9, E = K . The best published result to date is due to Schwichten- 
n 

n+1 
berg [51], who proves that E = K for n ^ 3. Meyer's proof rests on 

the complexity-theoretic properties of the Gzregorczyk hierarchy which we 
established earlier. 

n+1 
He begins by proving that for n ^ 3 K <= E , using an inductive 

argument to show that every function in one class is majorized by some 

function in the other class. This yields the result, since if f appears 

n+1 
in K^ by an instance of primitive recursion, then g > f for some g e E , 



f 
Muller has announced the result for n > 2 in the Recursive Function Theory 
Newsletter, No. 5, April 1973. 
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and so f e E by an instance of limited recursion with g as bounding 
function. 

The proof that E c K ^ for sufficiently large n is dealt with using 

explicit complexity-theoretic arguments. Since IJ K exhausts the primitive 

n€N n 

recursive functions, (e, ~x~ , y) belongs to K for some n . Moreover 

m "o-i ° 

since the running time of f is bounded by some function in E n , and hence, 

by the above, by some function t e K , Meyer concludes that f = 

_ Vl 

°n/ e f' X m' t ^\? S> G K n ' where e f is a Godel number for f. He shows that 

n <: 9, and thus for sufficiently large n, K = E^* 1 
u n 

This is a rather striking result in that it relates the size f, the 
running time of f, and the syntactic form of f. The same general method 
yields Schwichtenberg ' s result, although the details of the construction 
of in K is much more difficult. 

Several investigators have considered syntactically formulated 
hierarchies which are quite similar to the depth of nesting hierarchy. 
Parsons [63 ] observes that iteration is the feature of primitive recursion 
that increases functional complexity. Using this as a guide, he defines a 
hierarchy based on nested iteration rather than nested primitive recursion. 
With this phenomenon in mind, he builds his classes £ P so that functions 
defined by primitive recursion are placed in this class only when p 
nested iterations takes place. He shows that for p2:2 £ P = E P 

Schwichtenberg, [51] and Meyer and Ritchie [58] also build hierarchies 

similar to the depth of nesting hierarchy. They place f e K Slm in case 

n 

f is defined from functions in K im by an instance of simultaneous recursion. 

n- 1 

They show that for n ^ 2 K Sim = E n . 
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Meyer and Ritchie [59 ] propose yet another syntactically formulated 
hierarchy. They consider a simplified programming language, and they 
measure program difficulty by depth of nesting of LOOP-END pairs. Their 
language consists of five possible types of expressions, (1) Set Xtox+1, 
(2) Set XtoY, (3) Set X to zero, (4) LOOP, and (5) END. A sequence of 
instructions is a Loop program when LOOP and END instructions are matched 
like left and right parentheses. LOOP-END pairs affect the normal sequ- 
ential flow of the program. If P is a Loop program, and register X contains 
integer x, then "LOOP X, P, END" means that program P is to be executed x 
times before the next instruction (if any) after the END is executed. 

A program hierarchy L is constructed by placing program P in L if 

11 n 

P includes LOOP-END pairs nested to depth at most n. A hierarchy of 

functions £ for n 2 is now derived from the L hierarchy: f e £ in 
n n J n 

case some P e L computes f. 

Since loop structure and the schema of primitive recursion are very 

similar, a routine inductive argument shows that U 1 = primitive recursive 

n 
n 

functions. Moreover, Meyer and Ritchie are able to relate their Loop 

hierarchy to Gzregorczyk' s by linking the classes I directly to the modified 

n 

Gzregorczyk functions g . They define a sequence of functions h as follows: 



n 

fx+1 if x = 

x+2 if x > 2 , 



n 



h n+1 (x)=h n (x)(i). 
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A routine calculation shows that for k s 2, h^ = g . Using the functions 
h^ they very elegantly prove the following bounding theorem. 

Theorem : For n > 2 f e £ » f can be computed by some loop program whose 

(k) 
running time is bounded by h for some fixed k. 

n 

This result is almost the same as the bounding lemma which Meyer and 

Ritchie prove for the Gzregorczyk hierarchy. Indeed, it is not hard to 

show that the two results are essentially identical, establishing the 

following theorem: 

Theorem : For n ;> 2, Z = E n+1 . 
n 

Thus, depth of nesting of loops gives yet another reformulation of 
the Gzregorczyk hierarchy. We now know that loop structure, function size, 
running time, and depth of nesting of primitive recursions all yield 
essentially equivalent notions of complexity for the primitive recursive 
functions . 

Section 2 . w-hierarchies of Elementary Functions 

Another important topic of hierarchy research has centered aroung 
^-hierarchies of the elementary functions. Ritchie's work [66] was the 
first investigation in this direction. He develops a hierarchy of the 
so called "predictably computable" functions, which he demonstrates to be 
precisely the elementary functions. While complexity theory, and in 
particular space considerations, are intrinsic to his hierarchy, his 
approach is much like Gzregorczyk' s in spirit. 

We briefly discuss a variant of Ritchie's hierarchy, due to Herman, 
and we also consider a formulation based on register machines, due to 
G leave. 
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As in the case of ^-hierarchies of primitive recursive functions, the 
hierarchies discussed here are closely related, although in this case they 
turn out to be distinct. 

Ritchie's work yields the following characterization of the elementary 
functions: a function f(0 is elementary if and only if some Turing 

.2 max <\\ 

2"" f n 
machine computes f and uses no more than space 2 J for all 

x^ where n is some fixed constant which depends on f and which is indepen- 
dent of x fc . His work is specifically based on one-tape Turing machines with 
binary input and output. Such conventions are significant here since the 
elementary functions are intimately related to the arithmetization of various 
machine models. 

Definition : Let T be any Turing machine. LetCT (x.., • • • , x ) be the number 

T i n 

of tape squares used by machine T on inputs x.. , •■•, x , if T converges on 

i n 

these arguments, and undefined otherwise. 

Ritchie begins by defining F , the base of his hierarchy, to be the 
class of finite automaton computable functions. He shows that this class 
contains the successor function, the constant functions, and the projection 
functions, and is closed under composition and addition of functions. He 
defines his hierarchy as follows: 
Definition : The Ritchie hierarchy. 

1- F = the finite automaton computable functions. 

2 « f e F i+ x in case som e machine T computes f and G < g for some 
g e F . 
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Thus f e F. is "predictable computable" in the sense that the space 
needed to compute f is bounded by some function in F.. In a moment we will 
sharpen the notion of predictability by giving explicit upper bounds on the 
space needed to compute f e F ,■ 

It is easy to prove that F c F c • • • c F <=•••. To show that all 
the containments are proper, Ritchie develops a sequence of functions f^, 
f , •••, f , ••• which are similar to the Gzregorczyk functions, and which 

J. JK 

yield canonical estimates on the size of functions in F • 

f (x) 
Theorem : Let f (x) = x, and let f^. 1 (x) = 2 . Then for each n, f^ e F^ 

and if g e F , then g(x-, •••, x ) < f (K«max(x , ••*, x )). 
n l n n J- n 

Easy inductions prove both claims, and since for strictly increasing g 

2 S maiorizes k»e £ ■, t- F • Tnis establishes the Ritchie hierarchy theorem. 
J b ' n+i n 

Theorem : For all n £ 0, F 5 F n+ i" 

Ritchie next establishes that the elementary functions E c U F • He 

n 

accomplishes this by showing that exponentiation is in F„, and that explicit 

transformation, limited recursion, a n d composition do not lead out of the 

F-classes. Finally by carefully analyzing and reworking the Kleene normal 

form Theorem, Ritchie is able to show that every f c U F, is elem- 

n 
entary. Thus his hierarchy is precisely a hierarchy of the elementary 

functions. 

In [44] Herman develops a variant of the Ritchie hierarchy, based on 

unary Turing machines. As in the Ritchie formulation, Herman places 

f e G. in case some machine T computes f and G„(x. , •••, x ) < f 1 (K«max(x . . .x ) ) 

1 i 1 Tl 1™ - 1 - j. ii 
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By examining carefully the resource needed to convert between binary and 
unary notation, he proves that for all i > F. cz G 1 C F ., and thus 

that U G. = the elementary functions. 

i 

Cleave [81] proposes another method of building hierarchies, based on 
register machines. He fixes a set of functions T-, and defines a E-program 
to be a finite sequence of instructions 1(1), 1(2), ..., I(k). Instructions 
may be of two forms: I(j) may be arithmetic, that is, of the form 
F(R 19 •••, R ) -» R (For F e E, apply F to the contents of registers R ••• R , 
and place the result in R ) ; or jump, that is J . (a, 0) (if R. = 1, go to 
instruction 1(a), and otherwise, go to 1(0)). He limits his machines by 
specifying a special register J which is decremented by one each time a 
jump instruction is executed. When J = 0, the program halts. 
Definition : A function f is (h-JC) computable (that is, f e (E) ) if some 
E-program P computes f at each argument x, with special register J initially 
set to h(x) . 

Using this notion of bounded computability, Cleave constructs his 
hierarchy. 
Definition : The Cleave hierarchy. 

1. f e £„ ° f e (E) for some constant function h 

2. f e £., « f G (S) s for some g e £ • 

n+i n 

For E = (+, x, =} Cleave shows the following: 

Theorem : T, 5 21 5 * * * 5 ^ 5" " * " » anc * U S = elementary functions. 
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In [45], Herman considers the equivalence of the Ritchie and Cleave 

hierarchies. He shows that for £ = {+, =} , (J S = elementary functions, 

n 
n 

and using an induction argument based on Ritchies functions ff } „, he 

L n J neN 

shows that for i * 0, F. % G. +1 J E. +2 £ F. +2 £ G^. 

Section 3 . Trans finite Hierarchies 

In the first part of this chapter we discussed w-hierarchies of two 
well understood, effectively presentable subclasses of the recursive 
functions, the primitive recursive functions, and the elementary functions. 
In this section we discuss various attempts to build natural, effectively 
constructed trans finite hierarchies which are designed to exhaust the 
class of recursive functions in a non-trivial way. The results we con- 
sider here are almost without exception, negative. The fundamental 
difficulty with building exhaustive hierarchies is the highly non-in- 
variant character of the ordinal names used to index such hierarchies. 
These "naming" difficulties have led to the formulation of transfinite 
hierarchies with more modest goals, namely, the construction of hier- 
archies indexed by apparently "natural" aaames for a small subset of the 
constructive ordinals. We discuss no n- exhaustive hierarchies of this 
type at the end of this section. 

One natural and attractive approach to the problem of constructing 

exhaustive transfinite hierarchies is through ordinal recursion. One 

might formulate such a hierarchy informally as follows: place a function 

f e F for a. < w (the first non-constructive ordinal), if f can be 
oi 1 " 
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defined by ordinal recursion over some well ordering (3 ^ a involving 
functions in F^ for \ <, a. By unnested recursion over a well-ordering R of N 
we mean the following: 
Definition : Let R be a well-ordering. Define R to be 

f x if xRa, 
xRa = [ 

(^ otherwise; 

Then a function f is defined by ordinal recursion over R (or unnested 
R-recursion) , from given functions g , •••, g if 

f(0) = n 
f(a+l) = h(a), 

where h(a) has the form p(a, f(q(a) R a+1) ) , and p, q are built up from 
S l' *"' ^k ^ y composition. 

Definition : Let U(R), the unnested R-recursive functions, be the smallest 
class containing + and closed under composition, explicit transformation, 
and ordinal recursion over R. 

The next theorem shows that the proposed hierarchy outlined above 
collapses at the earliest possible stage. The character of the proof 
hints at the close link between the "strength" of a transfinite hierarchy 
and the ordinal names used to index the hierarchy. 

Theorem : Myhill, Routledge [ SO) , I 50] , [ 3 U and [32]. Let f be any 
recursive function. Then there exists a recursive well-ordering R 
can be shown to be elementary) of order type w such that f e U(R) . 
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One proof of this theorem proceeds by constructing R from the running 
time function § for some Turing machine T which computes f. R is built 
with an encoding of $(0), $(1), ••• embedded in it in an R-ordinal 
recursive way. $ can be extracted from R in an ordinal recursive way, and, 
using the Kleene T-predicate and §, one shows that f e U(R). 

This is certainly a provacative result; it indicates that if there 
is to be any hope of a successful transfinite hierarchy of the recursive 
functions, then the issue of ordinal names must be treated with considerable 
care. 

With this in mind Kleene [27], proposed a subrecursive hierarchy in 
which classes of functions are attached to the nodes of 0, the Church- 
Kleene system of ordinal notations. We assume the reader is familiar 
with 0; a readable account of and its properties may be found in 
t 2 , pp. 205-213]. 

Hoping to avoid the difficulties which arise from the MyMll-Routledge 
result, Kleene restricts by allowing only primitive recursive funda- 
mental sequences. He shows in fact that under this restriction still 
names all the ordinals < to . In what follows, we assume is restricted 
in this way. 

Loosely speaking, Kleene' s hierarchy starts with the primitive 
recursive functions at the base level, and is built up at successor levels 
by taking an enumerating function for the previous class and forming its 
primitive recursive closure. At limit notations Kleene assigns the 
primitive recursive closure of a function which encodes the enumerating 
functions of the classes named by the fundamental sequence. 
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Definition : The Kleene subrecursive hierarchy. Let pr (a,b) enumerate 

the functions primitive recursive in f. The enumeration procedure pr 

is uniform in f. Associate a function h with each x e as follows: 

x 

(i) if x = 1, let h (b,a) s 

x V 

(ii) if x = 2 y , let h x (b,a) = p (b,a) 

V>2 (b)) 



(iii) if x = 3«5 let h (b,a) = pr(TT..(b), z)) 

3C J. 



To each x e assign the class of functions P , where P = the primitive 

x x 

recursive closure of h . 

x 

Let us consider the issues Kleene 's hierarchy raises. To be completely 
successful, his (or any similarly formulated) hierarchy should satisfy 
the following properties: 

(i) (uniqueness) For each a < w if x, y GO and |x| = |y[ = 

a (i.e. if x and y are notations for a) then P = P ; 

x y 

(ii) (proper expansion) For each a < w , \J P 5 R, , the recursive 

functions; j x| Q <a' 

(iii) (completeness) (J P = &; and 

xeO x 

(iv) The mapping x -4 P should be reasonably constructive, e.g., 

x 

P is uniformly r.e. in x. 
Such a hierarchy would provide considerable information about the 
class of total recursive functions. It would imply (subject to the 
restriction to primitive recursive fundamental sequences) that sub- 
recursive hierarchies are ordinal invariant: no matter what choice of 



-29- 



names we select, we always generate the same sequence of classes of 
recursive functions. Moreover a hierarchy satisfying the properties 
listed above would provide us with a useful classification technique 
for measuring the complexity of recursive functions. We could identify 
the complexity of a function f with the least ordinal a such that 
| x | = a and f e P . This would be a significant measure of function 
complexity, since uniqueness would guarantee that no function f could 
appear at an artificially early level. 

Unfortunately the Kleene hierarchy, and indeed any reasonably con- 
structive hierarchy built in must fail to satisfy the first three 
criteria. This breakdown means that any transfinite hierarchy of 
recursive functions must depend critically on the choice of ordinal names 
used to index the hierarchy. These negative results have made the aims 
of subrecursive hierarchy theory much more modest, and as we shall see 
much of the recent work on hierarchies is concerned with finding "nice" 
names for sequences of ordinals, and building non- exhaustive hierarchies 
along these paths. 

Axt [12] is the first to consider Kleene' s hierarchy. He shows that 

2 
indeed the Kleene hierarchy is unique f or a < u . However, he also shows 

non-uniqueness at a : there exist x, y e such that |x| = |y| = " 

but P ^ P . 
x y 

Feferman [38] considers Kleene' s hierarchy in a more general setting, 
and his work reveals a great deal about difficulties involved in building 
successful hierarchies in 0. Feferman proves his results for any 
"primitive recursively expanding hierarchy", that is any hierarchy 
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satisfying five (rather complicated) abstract properties, the most re- 
strictive of which specifies that classes at limit notations must contain 
a function which diagonalizes across the classes named by the fundamental 
sequence. 

His first result shows that in a primitively recursively expanding 
hierarchy, and in the Kleene hierarchy in particular, every recursive 
function occurs at a low level. 

Theorem : Let {Pj}j £f) be the Kleene subrecursive hierarchy. For any 
f e ft there isadeO, |d| = <*> , such that f e P . Moreover for any 
b e there is a d e 0, b < d and |d| = |b| + (o such that f e P . 

Feferman proves his theorem by showing how to encode any recursive 

2 
function into a notation for w . This result shows that for a large class 

of hierarchies, uniqueness must fail. 

In [62 1» Parikh strengthens Feferman' s non-uniqueness result. 

Definition : (Parikh) A recursive transfinite progression of sets of 

functions over (or any suitable subset of 0, for example, restricted 

to primitive recursive fundamental sequences) is an r.e. predicate 

C(p, q, a, b) such that 

(i) x e implies that for any a, {< p,q > | C(p,q,a ? x)) is a function 

f » N -» N; and 
»., x ' 

(ii) If x, y £ and x < n y, then C C C , where C = {£ I 3a (f - f )} 
v/ * J x ? y x ' a,x 

and C = {f | 3a(f = f )} . 
y l ' a,y 
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For such recursive transfinite progressions, of which Kleene's hierarchy 
is certainly an example, Parikh proves the following theorem. 



Theorem ; Every recursive transfinite progression of sets of functions is 

lo 



2 2 

w +1 non-unique; that is, there exist x, y e 0, IxL = u + i such that 



x y 

Parikh's theorem is proved by methods similar to but simpler than 

those used to prove Feferman's result. The generality of his theorem is 

convincing evidence that transfinite subrecursive hierarchies are highly 

ordinal-name dependent. 

Feferman has two other results, which, taken together, give concrete 

information on how dependent the strength of a hierarchy may be on the 

indexing ordinals for the hierarchy. By a path Z in we mean a subset 

of well-ordered by < and containing, with any d e Z, all the predecessors 

of d. Let |z| denote the order type of Z. 

Theorem : Let K be any ordinal £ W- . Then there exists paths Z, Z 1 c 0, 

|z| = K + u for K < cj 1 , and|z'| = u for K = c^, such that U P = 

U P = ft. 
xez' x 



xez x 



To prove the theorem with K < co Feferman enumerates the recursive 
functions (a highly non-constructive procedure), and then, using -t> n he 

iterates the techniques of his earlier theorem to obtain all the functions 

3 
by K + u . For K = u , he enumerates and the recursive functions, and 

he builds Z by alternately obtaining a new function, and then adding (+.) 

the next element in the 0- listing. This result establishes the existence 

3 
of "complete" paths of length as short as u , and as long as u . This 
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is certainly a striking instance of ordinal non-invar iance. It also shows 
that proper expansion is an impossiblity, at least for hierarchies of 
the Kleene type. The next result sharpens this phenomenon even further 
by showing that there are "incomplete" paths of length w 
Theorem: These exist incomplete paths in of length u . That is, there 
exists a path Z g 0, |z| = u , and an f e ft such that for all d e Z, 

f t P.. 
a 

This is one of the deepest results in the theory of subrecursive 
hierarchies. The proof of the theorem builds on work done by Feferman 
and Spec tor in [39], in which a "non-standard" version of 0, 0* is 
studied. is defined inductively as the intersection of all hyper- 
arithmetic sets X satisfying 

(i) leX 

(ii) if d g X, then 2 e X and d < x 2 

0* 

(iii) if «p (n) e X for all n and cp (n) < ^ cp (irt-1) for all n, 
e e o* e 

e * 
then 3*5 e . 

Interested readers unfamiliar with hyperarithmetic sets and their 

properties should consult [2, pp. 381-402]. 

Using this inductive definition, one can construct subrecursive 

hierarchies in 0* exactly as one constructs them in 0. Moreover, 

* 
OqO and for d e 0, the class of functions P J attached to the d-node 

* 

in is exactly the same as the class P d in . Feferman and Spector 
show that for any d g - 0, Z = C'(d) ,( where C'(d) = {x | x < d}) 
is a tt^ path through of order type Wy (For background material 
on n^-sets, the interested reader should consult [ 2, 397-403]). 
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1 • * 

Picking such a TT.-path Z in 0, we knew there is a d e such that 

d "sits on top of" Z. Since the -hierarchy overlays; the 0~hierarchy and 

agrees with the 0-hierarchy on 0, we know that F, mast properly contain 

U P« Hence U P must omit some recursive function,, and the following 
xeZ x xeZ x 
theorem, which applies to any subrecursivei hierarchy in 0, is therefore 

established: 

1 * 

Theorem : Let Z be a tt -path through such that Z ~C*(d) (T for d e . 



Then there exists f e ft such that f k U ? • 

xez x 
Combining the last two results, we see" that the exhaustive' power of 

a subrecursive hierarchy, at least of the Kleenaar-typev is intimately 

tied to the ordinal notations used in the- hierarchy. In short, these 

3 
results say that there are short (to ) complete hierarcliiesv andV long (<0 

incomplete hierarchies. 

An: unpublished result of Mochovakis f&2 ] provides stilX more infor- 
mation on the behavior of hierarchies in 0, 

Theorem : For a e (or any suitable version of Q t for example, Kleene's 
restricted to primitive recursive fundamental sequences.), let :. A. £ N. 
Then one of the following must fail: 

1. A = U A is hyperarithmetic; or 

aeO a 

2. P(x,a) s [a e and x e A ] e n- ; or 

3. For each constructive ordinal a, U A c: A. 

l*! <Qf x - 
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Properly interpreted, this theorem says that for any hierarchy on 
built up in any manner which could possibly be considered constructive, 
if the recursive functions are exhausted at all, they are exhausted by 
some bounded level in 0. 

Mochovakis proves his result by considering the tt -predicate 
Q(x,a) = [[x i A and a = 1] or [x e A and (P(x,a))]]. The uniformization 
theorm [2, p. 430] says that there must be a hyperarithmetic function g 
such that Vx Q(x, g(x)); but then the range of g is an unbounded hyper- 
arithmetic subset of 0, a contradiction. 

In the case of the Kleene hierarchy, if we set A = { e | cp e P ) , 

3, 6 3. 

then (1) and (2) are true, and so (3) must fail. Indeed, we saw for 

2 
Kleene 's hierarchy that this failure occurred at to . Thus, even if one 

gives up the goal of uniqueness for hierarchies in 0, one must still 

contend with the problem that either the hierarchy will collapse by some 

bounded level, or it will omit some function. 

By what we have just seen, hierarchies in are extremely badly 
behaved. Such hierarchies can still be of use, however, for proving 
theorems about the various methods used in constructing hierarchies. As 
an example of this we consider the Bass-Young hierarchy [70]. This work 
has inspired many of the results in Chapter 2 of this thesis. In what 
follows, the reader is assumed to be familiar with Section 2 of Chapter 2. 

Bass and Young build their hierarchy by starting with some complexity 
class 3f(t-), where t- is some sufficiently large recursive function. 
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At successor stages they assign to notation 2* the class ^(t^), where 
t 2 x is obtained from t by an application of the honesty theorems followed 
by an application of the compression theorem. At limits they apply the 
union theorem of Meyer and McCreight [83], [84]. The resulting hierarchy 

is a recursive progression of sets of functions in the sense of Parikh, 

2 
and so is non-unique at u +1. However, Feferraan's results do not apply: 

the union theorem insures that a limit class is precisely the union of 

the classes named by the fundamental sequence. In particular, the function 

which diagonalizes across the classes determined by the fundamental 

sequence does not appear in the limit class. Indeed, an appeal to the 

speed-up theorem of Blum [ l ] and the well-foundedness of shows that 

no function with h-speed-up can appear anywhere in the hierarchy. Here 

h e ft 2 » ' t * ie compression function used to build the hierarchy, is assumed 

to be monotone in its second argument. Using these techniques Bass and 

Young are able to construct a hierarchy on the full g in which every 

A 
function is in the Gzregorczyk class E . 

Bass and Young use Parikh *s non-uniqueness result to establish 
several results about inherent irregularities of honesty procedures. 
For example, they prove the following theorem. 

Theorem : For sufficiently large h e ft 2 there exist honest functions t , 
t 2 such that yct^. = 3f(t 2 ), but ?(h(x, t 1 (x)))^ y(h(x, t^x))). 

This result and others like it in their paper led directly to our 
work in Chapter 2 on the honesty phenomenon. 
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By what we have just seen, the no n- invariant character of ordinal 
notations makes the construction of a meaningful exhaustive hierarchy of 
the recursive functions extremely unlikely. The construction therefore of 
"short" hierarchies which classify only a portion of the recursive functions 
seems to be a more legitmate if more modest goal. 

We survey several approaches to this problem. Hierarchies can be 
built up by unnested and nested ordinal recursion over particularly natural 
well orderings. By restricting attention to such well-orderings one can 
avoid the difficulties inherent in the Myhill-Rou tledge result. Another 
approach extends existing w-length hierarchies into the transfinite. We 
discuss invariance between these hierarchies. A linearly-ordered Kleene 
hierarchy can be constructed by selecting a nice path in and examining 
the Kleene hierarchy restricted to this set. The results of these investi- 
gations show that if one chooses ordinal names with care, then one can 
indeed build interesting and singificant hierarchies of portions of the 
recursive functions. 

We begin by discussing work by Tait [52] relating unnested and nested 
ordinal recursion over a well ordering R of N. Recall that for R a well- 
ordering, the function xRy is equal to x if xRy and otherwise. 
Definition : A function f is defined by nested R-recursion over R from 
functions g-, •••, g, if f satisfies 

f(0) = n, 
f(a+l) = h(a), 
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where h(a) is built up from g.., •**, g, a nd f by composition, but where 

J- K. 

every application of f has the form f(xR a+1) . 

Definition : The R-nested (ordinal) recursive functions, N(R) , is the 
smallest set containing + and closed under the operations of composition, 
explicit transformation, primitive recursion, and nested R-recursion. 

Tait points out that, in the case of unnested R-recursion, computation 
of f(a+l) proceeds in a linear way down a well-ordering until f(0) is reached 
and evaluated. For nested R-recursion, the computation of f(a+l) may lead 
to a computation tree, and the value of f (a+1) cannot be determined until 
the computations on each path of the tree have been reduced to known functions 
or constants. The comparison of th~.se two types of recursion lies in the 
analysis of these two forms of computation. 

Definition : Let R be a well-ordering. Define R to be the limit of all 

a. a~ a 

polynomials in w of the form lo »a. + w ^a + ••• + to n «a , for a ^ 

12 n n 

* |r| 

a _-^ ^ ••• ^ a.. < R, and a •••, a integers. R has order type to 1 ' . 

If R is a recursive well-ordering of N we can assign integers to 

* 
polynomials in to of the above form. This assignment induces an R ordering 

of N, and it is not hard to show that this ordering is primitive recursive 

in R. 

Definition : Define < = u, < = < y < ; define Q„ = <, , Q , = <"• 
1 n+1 n+1 n 1 n+1 n 

n 

Thus, i< = w ' and |q J = to . Moreover, for each n < and 
1 n ' n+1 1 n 

Q are recursive well-orderings on N. 

n 
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Using tree analysis of nested compufcaions as a guide, Tait shows 

that for the well-orderings < , nested recursion on < , - is reducible to 

n n+1 

unnested recursion on Q • 

n 

Theorem : For n s 0, if f e N(< J then f e U (Q ). 
n+i n 

Robbin [68] proves the converse of Tait's theorem and puts these 
results in a more hierarchy theoretic framework. He obtains significant 
results about various short hierarchies and their relationship to one 
another. In particular he relates these results to the multiply-recursive 
functions of Peter [10]. 

Peter invented the multiply recursive functions after Ackermann 
had shown that nested double recursion (Ackermann' s function) leads out 
of the class of nested single recursion definable functions, the primitive 
recursive functions. The function ijr defined by the equations 

i(f(o,n) = n+1 

i|/(m+l, 0) = <|r(m, 1) 

i]/(m+l, n+1) = \|f(m, i|/( m+1 > n )) 

is an example of a "2-recursive" function: the inductive definition is 
done over two arguments, and the computation of ij; is nested in the sense 
that to compute i}r(m+l, n+1), one must first evaluate i|r at other arguments. 
Peter generalizes this to k variables for k > 2 and obtains the "k-recursive" 
functions for each k > 0. She considers the k-recursive functions with k 
as a parameter, the so called multiply-recursive functions, and shows by a 
diagonal argument that for each k, the k+1-recursive functions properly 
contain the k-recursive functions. We denote the k-recursive functions by N . 
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Robbin's first main theorem relates nested and unnested ordinal 
recursion to the Peter hierarchy. 

Theorem : N ,, = N(< ,.) = U(Q ). 

n+1 n+1 n 

Robbin relates these results to an extended version of the Gzregorczyk 
hierarchy and a linearly ordered portion of the Kleene hierarchy. He deals 
with the problem of ordinal notations by specifying very carefully how 
limit ordinals are to be approached. 

Definition : For a a limit ordinal <w } let a = " (P+l) . Define \na(n) 
such that lim o/(n) = <y to be o<(n) = to • (3+co -n. 

Using this definition Robbin defines a sequence of Gzregorczyk-like 
functions W which are quite similar to the modified Gzregorczyk functions 
g later introduced by Meyer and Ritchie. 

Definition : For a < <j , define w as follows: 

a 

1. W Q (x) = 2* 

2. W .,(x) = W (X) (1) 

3. w (x) = w (x) for a a limit ordinal. 

a o/(x) 

The w 's provide a natural way to extend the Gzregorczyk hierarchy. 

CO (y rv 

Definition : For each a < to , define E to be E(W ), that is j = 
the functions elementary in W . 

It is easy to see that a proper hierarchy is established. Robbin 
is able to show that his extended Gzregorczyk hierarchy refines the hier- 
archy of multiply recursive functions, and hence also the nested and 
unnested ordinal recursion hierarchies. 



-40- 



Theorem: For or < p, E^ ^ E P ; moreover, for each k N, = [1 E . 

Rbbbin's proof uses ideas which were employed later in the Meyer- 
Ritchie account of the Gzregorczyk hierarchy. He proves a bounding lemma 
relating the size of the W 's to the multiply-recursive functions, and a 

key step in his proof is an appeal to the honesty of the functions w . 

a 

We remarked earlier that the 1-recursive functions of Peter are the 

primitive recursive functions. If f(x) = g (x) (l), we say that f is obtained 

from g by 1-fold iteration, and we can generate the primitive recursive 

functions by using this iteration scheme instead of the schema for primitive 

recursion. Robbin extends this equivalence, showing that the k-recursive 

functions can be obtained by replacing the schema for k-recursion with a 

schema for k-fold iteration, a generalization of 1-fold iteration. 

Using k-fold iteration, Robbin gives an analysis of a Kleene-type 
to 
co -hierarchy in terms of the multiply-recursive functions. He defines his 

hierarchy as Kleene does, but he chooses a single path through out to 

CO 

w , the path determined by his Qf(n) fundamental sequences. 

CO 

Theorem: Let P^, a < to be the Kleene subrecursive hierarchy restricted 
to the 0-path determined by the a(n) fundamental sequences. Then for 

n :> 1, N = U i P • 
n J"-l a 

Robbin' s work is an excellent example of how short hierarchies can 
yield information about various notions of difficulty for subclasses of 
the recursive functions. His results relate nested and unnested ordinal 
recursion to the multiply-recursive functions, and through the extended 
Gzregorczyk hierarchy, to the actual size of functions. 
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Earlier we discussed a construction of Cleave* s which yielded an 

w-hierarchy of the elementary functions. In the same paper Cleave extends 

2 
his hierarchy to u , and shows that the resulting hierarchy exhausts the 

primitive recursive functions. 

2 
Definition : The u -Cleave hierarchy. 

(i) f e Eq « f e (E) for some constant function h 
(ii) for k> 0, f e E^ e fe© b for h e Z^^, 



(iii) for r > 0, f e E » f e ' fl E , , N , 



Cleave's work is of interest for several reasons. First, the con- 

2 
struction of a proper u length hierarchy of the primitive recursive 

functions indicates that ordinal length, even for hierarchies which only 
exhaust a portion of the recursive functions, can be a misleading measure 
of hierarchy strength. (Of course, the subsequent construction by Bass 
and Young of a proper hierarchy in the full which fails to exhaust E 
is a more spectacular example of this phenomenon.) Second, Cleave's con- 
struction brings out some of the difficulties involved in the construction 

of hierarchies by machine theoretic means. Indeed, Cleave points out that 

2 
his hierarchy must die out at u . He argues as follows: since each program 

is of fixed length, P = 1(1), 1(2), ..., i(k), if f e E 2 then all the 

functions used to define f must appear in X^ for some k. Hence, extension 

2 
of the chain beyond co yields nothing new, since any f eS. , say, must 

" +1 
already appear in some E , . 

m»k 

This inherent limitation of Cleave's approach is by-passed by Constable 
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[18], who uses RASP machines to extend the Cleave hierarchy to e_, the limit 

CO 

of the sequence oj, to , to . , • •• .A RASP machine is perhaps the closest 
to real computers of all theoretically proposed machines. Its fundamental 
characteristic for our purposes is its ability to monitor and modify itself 
in the course of a computation. This is a fundamental difference. between 
RASPs and register machines, and this difference accounts for Constable's 
successful extension to ?.. ■ 

For ordinals a < e Constable carefully handles the problem of finding 
nice fundamental sequences. He puts a in (unique) Cantor normal form, 

a = to *a« +••"'•• + u n *a for at. 2: «•• S: a . and 
1 n 1 n 

a, , •■•■• , a integers, 
J. n 

and then he defines his fundamental sequences: 

Definition: Let a <« rt be a limit ordinal in Cantor normal form as above. 

If a is successor ordinal, define 

n ■•■•■.' ;■."•'- ■"■■ ' 

a l . ■■ < *a" 1 

a(x) - to •a',"+ ••• + w »x; 

if a is a limit ordinal, define 

n ■•■,.' 

a i , <V X) 

a(x) = oj «a '+ ••• + to 

Using this formulation of fundamental sequences., Constable extends 

the Cleave hierarchy using RASP machines, and he also extends the Gzregorczyk 

classes (already extended to <o by Robbin) to e . His Gzregorczyk extension 

is a direct generalization of Robbin' s extension: for a < e Q , E = E( u a )» 

where W (x) = w , (x) if a is a limit ordinal, and W (x) = W , < x > iff a 
a of-1 a a(x) 

is a limit ordinal. His RASP hierarchy of length 
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e is proper because his RASP programs modify themselves in the course of 
their execution, thus avoiding the problems of the register machine 
approach. Constable establishes the following result: 
Theorem : For a < e Q E ^ 1 = RASP 1+ )+1> where RASP is the p RASP 
hierarchy class. 

Thus Constable is able to extend to e the growing body of results 
relating various generation methods for short hierarchies. 

In [71], Schwichtenberg also considers the equivalence problem for 
various e -length hierarchies. He shows that the modified Kleene hierarchy, 
the generalized Gzregorczyk hierarchy, and a standardized unnested recursion 
hierarchy all coincide up to e_. He defines standard fundamental sequences 
exactly as Constable does, and his version of the extended Gzregorczyk 
hierarchy is the same as Constable's. Moreover, he extends, with minor 
modifications, Robbins version of the Kleene hierarchy to e . His un- 
nested ordinal recursion classes, R , are defined in a rather unusual way, 

a 

and the analysis of these classes is the most original part of the paper. 

S 
Definition : Define well-ordering S of N as follows: S- = ^>, S ^^ = lo . 

A standard well-ordering of type a < e is a well-ordering of the natural 

numbers which is elementary-recursive isomorphic to an initial segment 

of S ,, for S < a <, S - . 
n+1 n n+1 

Schwichtenberg considers only standard well-orderings < g q ; functions 
defined by instances of unnested ^-recursion for standard well-orderings 
X < e are said to be defined by elementary \-recursion. The e Q -recursive 
functions, then, are the set of functions which can be defined by elementary- 
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A-recursion, X < e , from given e n -recursive functions and elementary 

functions in an elementary way. 

Schwichtenberg assigns ordinals < e to e -recursive functions, and he 

uses this assignment to define his ordinal recursion classes. If f is 

defined explicitly from g- , •'"» g, in an elementary way, then f is 

assigned the ordinal maxCc* 1 , , •••, a, ) , where the cc. ' s are the ordinals 

i k 1 

assigned to the g.'s. If f is defined ms.ing an u)«cf- elementary recursion 
from g_, •••, g , then f is assigned the ordinal max (a , •••, a ) + a- 
Defin ition: R is the set of recursive functions which are assigned 
ordinals ^ a. 

This rather curious definition is the key to Schwictenberg' s results: 
by allowing R to contain functions defined by w»cy recursions, he gives 
himself enough slack to prove his main result. 

Theorem ; For all a < e_ the extended Gzregorczyk hierarchy class E = 

J J a 

R = P , the modified Kleene class. 

a a 

The critical part of the theorem is the proof that R s E . Here 
SchwichtenbeiBg introduces a formal reduction system for the e n _ recursive 
functions, and he develops a step-counting function s f for each f e R 
which keeps track of the reductions necessary to evaluate f. He shows 

that for f e R , s e R . Moreover, he shows that each function in R 

a f ex ' a 

can be defined from elementary functions alone by a single U"ty recursion. 
Using this he establishes his claim by proving that each function in R 



a 



is majorized by W (g(x)), where g is some elementary function. 

a 
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SchwichteTiberg also notes that the e Q -recursive functions are equal 
to the so-called "provable recursive functions". A recursive function 
f is provably recursive if for some index e for f Vx 3y T(e,x,y) is 
provable in elementary number theory, where t is the Kleene T-predicate. 
For a thorough account of the provably recursive functions, see Fischer [4 0] 

Schwichtenberg's very elegant paper is one of the best examples of 
a successful hierarchy construction of constructive ordinal length. His 

CO 

work is a natural extension of Robbin's work from to to e^. 

In a sense the Schwichtenberg result may be one of the last investi- 
gations in short hierarchy theory, while work in the Schwichtenberg frame- 
work obviously could be extended beyond e , it is not clear what sort of 
insight such an investigation would provide. 

We turn therefore to a different method of classifying the recursive 
functions, the method of subrecursive degrees. 

Section 4 . Subrecursive Degrees 

As we have seen, subrecursive hierarchies constitute an important and 
extensively studied approach to the problem of classifying the recursive 
functions. A fundamental problem with the hierarchy approach is the 
difficulties inherent in attempts to exhaust the recursive functions in 
any meaningful way. An immediate attraction of the degree approach, which 
we turn to now, is inclusiveness : every total recursive function belongs 
to some primitive recursive (or elementary recursive) degree. 
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The degree approach was initiated by Kleene [27]. He directly 
applied the concepts and notations of Turing degrees of unsolvability to 
the subrecursive case to obtain primitive recursion degrees. 
Definition : Let f and g be total functions. We say f is primitive 
recursive in g, f | g, if f is definable in a primitive recursive way using 
g as an additional initial function. The degree of f, d(f) = [g | f £ g and 



P 



g^f} 



Following the development of Turing degrees closely, he defines d(f)U 

d(g) (the join of f and g), and d(f) 1 (the jump of f ) . d(f) U d(g) = 

f g 
d(2 . 3 ), and d(f)' equals d(h), where h is an enumerating function for 

the functions primitive recursive in f which is generated in a uniform, 
primitive recursive way. 

Kleene ends his work here, and Axt [12] continues Kleenes investigation 
of the basic properties of primitive recursive degrees. His main result is 
the analogue of the celebrated Friedberg-Muchnik Theorem. • 
Theorem : For each n there exists n pairwise incomparable primitive 
recursive degrees contained in the recursive Turing degree. 

We emphasize that primitive recursiveness is not the only notion 
which can be analyzed by a degree approach. Indeed, we could just as 
easily study elementary degrees or multiply-recursive degrees and achieve 
basically the same results. In fact, with few exceptions, theorems proved 
for one such concept carry over to the others with little effort. 

We can also consider studying subrecursive classes of functions, 
rather than degrees. 
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Definition : Pr(f), the primitive recursive class of f, is the set of 
functions primitive recursive in f. 

It is not hard to show that there is an order preserving isomorphism 
between the primitive recursive degrees and the primitive recursive classes 
(or, for that matter, between elementary degrees and elementary classes). 
Indeed, the map which sends d(f) -♦ Pr(f) is the desired isomorphism. 
Much of the work to date on the structure of subrecursive degrees has 
actually centered around subrecursive classes rather than degrees, and 
we consider these investigations now. 

Early work on the structure of subrecursive classes was done by 

Meyer and Ritchie [72]. They consider elementary honest classes, as 

outlined in Section 1 of this chapter, and they show that between any two 

Gzregorczyk classes E and E for n ^ 3, there are dense chains of 

elementary honest classes. They prove their result by interpolating 

between the Iterates of g , where E(g ) = E n and E(g ,,) *= E(\x g (1) = 

n n n+i n 

They also prove the existence of denumerable incomparable families 

3 4 
of elementary honest classes between E and E . 

Feferman [38] also has a density result: he shows the existence of 

* 
dense chains in , and hence that there are dense chains of primitive 

recursive degrees. 

Similar results by other investigators are discussed at the end 

of Chapter 3. 
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In a series of three papers [8 ], [85], and [86]. Machtey develops 
an extremely elegant structure theory for elementary and primitive recursive 
classes. 

Definition : let £(f) denote the subrecursive class generated by the 
recursive function f. If the class under consideration is the set of 
functions elementary in f, then C(f) = (C . (f) I i e N] , where C.(f) is the 

■~ '^-'1 ' '-"'1 

th r 
i function elementary in f. 

Central to Machtey 's approach is his complexity- theoretic point of 
view. He picks as a measure of computation Turing machine space (see 
Section 2 of Chapter 2 for definitions). He then makes a fundamental 
distinction: a class C(f) is an honest class if C(f) = C(S.) for some 
space function (measure function) S.; otherwise C(f) is said to be a 
dishonest class. The fundamental property of honest subrecursive classes 
is that they are complexity classes, that is, they equal the t-computable 
functions for some recursive function t. Machtey establishes a great many 
structure results in these papers, and we consider some of them. 
Theorem : Every countable partial order can be embedded in the dishonest 
subrecursive classes. 

Machtey proves this result using techniques developed by Sacks to 

analyze the structure of the r.e. Turing degrees. 

Definition : Two sequences of honest functions f , f 1 , ••• and g , g , ••• 

determine a gap_ if, for all i, C(f j .) ^ £(f i+1 ) , £(§ i+1 ) <= CCg^ , and 

£(f-) ^ £(§•)• An effective gap is a gap for which there is a set 

(i_, i , •••,} which is recursive in 0' (the complete r.e. Turing degree) 

such that for all i f. = co . and g . = cp . 

J x 2j J 1 2j+l 
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Theorem : Aay countable partial order can be embedded tn the honest 
subrecursive classes between any effective gap. 

This rather complicated result has two important corollaries. 
Corollary : The honest, subrecursive classes are dense; that is, if f and 
g determine honest classes C(f) C C<f), then there exists an h such that 
C(h) is honest, and C(f) 5 C(h) gC(g). 

Corollary: No r.e. properly increasing sequence of honest subrecursive 
classes has a least upper bound in the honest subrecursive classes. 

Machtey also proves the following result, which is rather unexpected 
given that the corresponding result fails for the r.e. Turing degrees. 
Theorem: The partial ordering of the honest subrecursive classes is a 
distributive lattice. 

The novel element of Machtey' s work is his distinction between honest 
and dishonest subrecursive classes. This is a distinction which allows 
the elegant methods of complexity theory to play a role, and leads to his 
more interesting results, for example, his lattice result for honest 
degrees. 

In [92], Ladner examines the structure of subrecursive classes and 
obtains results similar to Machtey' s. 
Theorem: The subrecursive degrees are dense, and are not a lattice. 

He also considers the problem of minimal degrees. 

Theorem : There exist minimal pairs of elementary degrees. That is, there 

exist recursive functions f and g such that if h s f and hSg. then h is 

e e 

elementary (here h s f means h is elementary in f ) . 
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Ladner is particularly interested in considering the range of his 
(or Machtey's) results. His methods certainly apply to primitive recursive 
or multiply-recursive degrees, etc., as do Machtey's. However, he also 
discusses abstract notations of reducibilities which, hopefully, will shed 
some light on concrete problems in theoretical computer science. We 
discuss one such notion here. 

Definition : A set S of unary functions is a space class if it is r.e., 
contains the identity, and for all f and g in S and constants c and c 
there exists an h e S such that 
(i) h is increasing 
(ii) h(n) :> c «f(n) + c 2 
(iii) h(n) k f(x(n)), 
(iv) h(n) Smax[f(n), g(n)]. 

The class of linear functions, and the class of polynomial functions 
are examples of space classes. 

Ladner considers 0-1 valued functions, that is "decision problems", 
for his notion of reducibility. If p(x) and g(x) are 0-1 valued, he 
defines p to be S- space reducible to g if some oracle Turing machine with 
oracle g computes p in space bounded by some function in S. 

He then concludes that for the degree structure induced by S-space 
reducibility, the two theorems of his paper quoted above are true. 
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Chapter 2 

Honest Bounds for Complexity Classes of Recursive Functions 



1. Introduction 

Let ?(t) be the set of recursive functions computable by machines 
using t(x) computation steps on argument x, for all but finitely many 
inputs x. We call t a name for the complexity class 'f(t) Suppose we 
allow our machines to run longer, say h(x,t(x)) steps on argument x, 
where h is some fixed recursive function. One might expect that for 
large enough h, permitting our machines to run longer by an amount h 
will always allow us to compute new functions, i.e. ^(t) is a proper 
subset of y(h(x,t(x)). This turns out not to be the case: the "gap 
theorem" [2], [3] implies that for every recursive h there exists a 
recursive t such that ^(t) = ^(h(x, t(x) ) ) . However, if we restrict our 
attention to names from a certain subclass of the recursive functions, 
then we can indeed uniformly increase the size of our ^-classes. 
Informally, we call a recursive function t "honest" if some machine 
computes t(x) in roughly t(x) steps for each argument x. (A precise 
definition is given in Definition 1 below.) Then according to the 
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"compress ion theorem " [3], there exists a single recursive function 
h such that for every honest t, ^(t) is a proper subset of ^(h(x, t(x))) . 
Thus the phenomenon of the gap theorem is avoided by restricting attention 
to honest functions. It is a surprising consequence of the ''honesty 
theorem" of McCreight and Meyer [A], [5] that there is no loss of 
generality in this restriction. Namely, for any recursive function t 
there is an honest recursive function t' such that ?(t) = ?(t'). 

In this paper we present a new simplified proof of the honesty 
theorem, and then we analyze the possible behaviors of precedures for 
constructing honest names equivalent to arbitrarily given names. Part 
of the motivation for this analysis springs from the construction of 
hierarchies of recursive functions based on computational complexity. 
Bass and Young [7] have observed that application of the honesty theorem 
followed by the compression theorem to a function t yields a reasonable 
natural "jump" to a larger complexity class. The behavior of this jump 
operation and the resulting hierarchy of course depend critically on the 
honesty procedure being used. 

Section 2 describes our notation and the axioms of Blum [1] which 
provide a machine- independent characterisation of running time; Blums 
measured sets [1] and classes of honest functions are shown to be essentially 
equivalent. Section 3 consists of our new proof of the honesty theorem. 

In section 4 we consider honesty procedures which work on partial functions 
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as well as total functions, and we show that such procedures must generate 
arbitrarily large names for any complexity class. As a corollary we 
obtain another "gap"- like theorem which shows that every complexity class 
has honest names which are arbitrarily large on all but a vanishing 
fraction of arguments, thereby strengthening a result of [8]. In section 
5 we show that honesty procedures restricted to total functions need not 
yield arbitrarily large names for classes, and can preserve monotonicity, 
thereby settling questions raised in [7], [4]. 

2. Preliminaries 



For notation from recursive function theory we follow Rogers [9]. 

For each n e /// , P stands for the partial recursive functions of 
n variables. R stands for the total recursive functions of n variables. 

We use "(a.e.)" to denote "almost everywhere", which for our purposes 
stands for "all but finitely many". Similarly "(i.o.)" stands for 
"infinitely often". 

If i]r and cp are partial functions and cp is undefined at argument x 
we adopt the convention that ir(x) < co (x) . 

Suppose (co , cp ,...} is a Godel numbering of P.. A measure on 
computation [1] $ = ($ Q , $ 1> ...) is a sequence of functions in 9 
satisfying 

1) Yi e /i^Tdom (cp . ) = dom (f . ) ] 
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2) \i x y[§ (x) = y] is a recursive predicate. 

If we think of our Godel numbering in the usual one-tape Turing machine 
formalism, then 

$ . (x) = "the number of steps in the computation of the i Turing 
machine on argument x" is a measure on computation. 

Henceforth let $ be some fixed measure on computation. Then we 
define for any total function t 

F(t) = (i € w\ qo ± € ft 1 and 9 ± £ t (a.e.)}, 

and 

*(t) - {<p 1 | i € F(t)}. 

That is, F(t) is the set of (indices of) total machines or programs which 
run in time t, and Sf(t) is the set of total functions computable within 
time t. Similarly we define for any partial function i|f 

F (t) <* (i € t#\ $ ± * ♦ (a-e.)) 

and 

3f p (t) - {qa 1 | i € F p (+)}. 

A sequence of partial functions ¥ = {t Q » ti» •••} is B * id to be an 
r.e. sequence of partial functions if \± xftjCx) 3 € P 2 ' 



• 62- 



Definition 1 . (McCr eight-Meyer [4]) A function if € P is g-honest for 
g € R 2 if there is an i such that cp . = ijr and $ . < \xg(x,\l/(x) ) (a.e.). 

Definition 2 . (Blum [1]) An r.e. sequence of partial functions 
^ = f ^ ' ^1' * * ' ^ is said to be a measured set " if 

\ixy[\]f . (x) = y] is a recursive predicate. 

The relationship between honest functions and measured sets is 
explained by the following theorem of Meyer-McCreight [4]. Since the 
proof appears only in McCreight' s unpublished thesis [5], we reproduce 
it here. 

Theorem 1. [4], [5]. Every measured set Y is made up of g-honest functions 
for some g € ft 2 ; furthermore the set of g-honest functions form a measured 
set. 

Proof. Let Y = {t^j t 1 » •••! be a measured set. By Definition 2 and 

elementary recursion theory there is an s £ R, such that \lr = CD . Define 

1 i s(i) 

g(x,y) = max{$ (j) j i, j < x and ijf.(j) < y] . 

s v *■) i 

Then for x > i we have § (x) < g(x, CD , . , (x) ) , and so for each i 

s Ui s ( i ) 

CP S , ± , = ty ± is g-honest. 



Measured sequence would be more accurate, but we conform to the 
terminology of Blum fl]. 
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To prove the second statement consider the partial recursive function 
<®ij/i i j.\ f° r ? €-B«.» which, roughly, imitates -\tp: (x) when ®..(x) appears to 
be g-honest from arguments j to x. More precisely 



<p ± (x) if [<x ^ j and $.(x) £ kor (x > j and 
^(x) £ g(x, (^(x)))] 

B^dCfy * jM^Cy) > k =»-« i (y) > x]] 

andf(Vy)(j < y ^ xXf^Cy) < x ^ $ i (y) 



<P a(i,i,k) (x > '" 



* g(y, qa i (y))]] 



otherwise. 



It follows from the definition of measure on computation that \i, j, 
k, x, zfej-yj x j.\( x ) = '~*J is a recursive predicate. Hence 

S = ^o-fi i k> ' i »^»' c 2 ^) ** a sseaaured set. 

We claimS equals the g-honest functions. Indeed if for fixed i, j, k 
$ ± (x) £ g<x, cn.Cx)) for all x > j and 

k:Smax(*.(y) | yfi j and $.(y) convergent}, 

then<P cr(i,j,k) -«>i 8Tld %i,j,k) is 8- honest - 

If however the preeeeding condition is not met, then© ,. .. diverges 
(a.e.), but such functions are also (by convention) g-honest. So S is 
a subset of the g-honest functions. 
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Furthermore, if y is any g -honest- function, then y = cp. for some i 

such that * t -(x) £ g(x, qs^x)) for all x > j for some j. Let k = 

max[$ (y) | y £ j and * (y) convergent]. Then y --<p ,' * , * arid we | 

1 i cr(i,j,k) 1 

conclude that S equals the g-honest functions. D 

We state, for completeness, the following generalized compression 

*■■'■'' 
theorem of Blum [1]. The compression theorem says that an r.e. sequence 

of partial recursive functions is a measured set precisely when a uniform 

procedure exists for constructing, for each function in the sequence, a 

0-1 valued partial recursive function whose complexity is only a little 

bit above the designated function. 

Proposition. Let Y ■« f^, ^, ...) be an r.e. sequence of partial "recursive 
functions. Then Y is a measured set if and only if there is a p € ft, and 
an r € £ t such that (1) <p is 0-1 valued, (2) domain (cp J - domain (t.), 
(3) $ r(i) * ^fPCi.x. t^x)], and (4) if qj g = :$ then * >f (a.e.). 

It is an immediate corollary of the compression theorem that if we restrict 
attention to recursive functions t from a measured set Y, then we can 
uniformly enlarge 5(t) by composing t with a fixed recursive function h 
independent of t. 

Corollary. Let Y be a measured set. Then there exists an h € ft. such 
that If t £ T, t € ft v then y'(t) c y(\x[h(x, t(x))]). 



* .■ ■ '-■■■ 

We remark that Blum's theorem in [1] p. 333 is incorrectly stated; 
the correct statement is given above. 
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Proof. Let h(x,z) = E§2£ [p(e,x,z)], where p is the recursive function of 

e^x 

the proposition. 

Definition 3 . Let s <E ft... s is an honesty procedure on P ] if ^e,x,y [cp g ^ (x) 
y] is a recursive predicate, and if for every e °f (co ) = ^ (® /„\)- 
Definition 4 . Let s € ft, . s is an honesty procedure on ft^ if A.e,x,x[co g( - e v (x) 
y] is a recursive predicate, and if for every total m, CD ,, is total and 

e s(e) 
Notice that not every honesty procedure on P, need be an honesty procedure 

on ft,: an honesty procedure on P, need not map total functions to total 

functions. However, suppose s is an honesty procedure on P^ which also 

preserves F-classes. That is, suppose that for every e, F (CD g ) = F p ^ s ( e ))- 

Then a minor modification of s yields an honesty procedure on P^ and on 

ft . Indeed, it is easy to show that s' € ft, defined by 

<V(e) (x) = — [CD s(e) (x) ' (cD e (x) + V x) } ] 
in such a procedure. 

Constable has observed that no honesty procedure on S ^ can be a 
total effective operator. We prove a corresponding result for honesty 
procedures on P, and effective operators (see [9] for definitions). 

Proposition . No honesty procedure on P, can be an effective operator. 

Proof . Let s be any honesty procedure on P,, and let t = cp . be any recursive 

function. Define using the recursion theorem: 



cc (x) = 
e 



co (x) if a z [co s( . ) (z) ^cp s(e) (z)l 



otherwise. 
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The computation of cp (x) is effective since cp , . and cp ... are in a 

e s(e) s(j) 

measured set. Clearly cp is either total or empty. If cp is empty, it 

follows that s cannot be an honesty procedure on P, , for then 3 (cp , . ) = 

1 p s(e) 

°f (CP ,. N ) = °f (cp .) cr p = <§ ( ). So op must be total. Then cp ~- cp . 
P s(j) p j ¥ 1 p e ^e e ^j 

and cp . . ? cp . , . ^ 

s(e) s(j) 

3. The Honesty Theorem 

The honesty theorem says that given any function we can effectively 
find an honesty function which names the same class. Our proof explicity 
exhibits an honesty procedure on P.. . Recall from section two, however, that 
with a minor modification we can obtain a procedure on ft as well. 

Theorem 2 . There exists an honesty procedure on P» . Moreover, s preserves 

F classes, namely for every e, F (cp ) = F (cp / „ ) . 
P P e poster 

Proof. Let e be an index for i|i. A function \lr ' such that F (*) = F (*') 

p p 

is defined in stages beginning with stage 0. At stage n the integers 

from to n will be ordered in a sequence or queue = q_, q. , ..., q , which 

U 1 n 

is updated from stage to stage. Also a zero-one valued function "pop" on 
the integers from to n is defined and updated from stage to stage. Let 

< x,y > be a one-one onto pairing function with projection functions rr 

and tt„. As a technical convenience we use the fact that the pairing function 

< x,y > is strictly increasing in its second argument, so that stage < x,y > 
always precedes stage < x, y+1 >. 
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We outline the idea of the construction. Dovetail the computations 
of i|r, § Q , $ 1 , ... , $ n • • . at all arguments. Whenever it is discovered 
that f(x) < ? i (x) set pop(i) = 1, and try to -.define. >'(«)•<*. (z) for 
some argument z. When pop(j) = 0, try to keep f(z) ;> S . (z) . The pop 
conditions on i and j may be inconsistent, and- the queue assigns priorities 
to the integers (programs) to resolve the conflict. The dovetail nature 
of the construction guarantees that i|r* will be honest. 
Stage n . 

A) Put n on the bottom of the queue (i.e. set q = n). Set 

n 

pop(n) = 1. Let TTjCn) = x, TT 2 (n) = y. 

B) If § e (x) = y , then for <; i £ n, if ^(x) > t(x) set pop(i) = 1. 

C) If i|r'( x ) has already been defined at some previous stage, go to 
stage n+1. 

D) Find the least i s n (if any) such that 

1) pop(q i ) =1 

2) * (x) > y 

3) (Vj < i)[pop(q ) = -+ § (x) <: y] 

q j 

If i exists, define f (x) = y, set pop(q.) = 0, and put q ± on the bottom 
of the queue. Go to stage n+1. If no such i exists, go to stage n+1. D 
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For anycp £ = i|r and any n > 0, stage n in the computation of ijf ' is 

effective and will terminate. Condition (C) guarantees that if f ' (x) is 

defined, it is defined at only one stage, and so ilr ' is well defined. 

Furthermore since our procedure is uniform in e, V = cp , . for some 

s(e) 

s € R 1 . Condition (D) guarantees that if f ' (x) is defined, it is 

defined at stage n = < x, f ' (x) >; hence the predicate \e x y|cp , „ (x) = y] 

s (e) 

is recursive (we need only run our procedure until stage < x,y->), and so 

, CO 

"■^sCe^e^ is a measured set - This implies by Theorem 1 that i|r ' will be 
g-honest for some g 6 ft independent of ijr . 

We now show that for each i, §. <. ^ (a.e.) <=> $. < i|r'(a.e.)- This 

immediately implies F (*) = F (*'). 

P P 

The proof divides into cases depending on the final positions of the 
integer i on the queue. If i reaches a final location on the queue we 
shall say that i is stable; otherwise we say i is unstable. 

Case 1: i is unstable . 

If i does not stabilize it must be moved to the bottom of the queue 
by step (D) at stage < x,y > for infinitely many x. Step (D) defines 
V O) = y < $ i (x), and hence $. > i|/'(i.o.). Moreover step (D) moves i 
to the bottom of the queue only if pop(i) = 1, at which time pop(i) is 
reset to 0. In order for step (D) to apply again to i, pop(i) must be 
reset to 1 by step (B) at some later stage. But condition (B) sets pop(i) 
to 1 only at stages < x, $ (x) > such that $ . (x) > i)f(x). Thus § . > i|r (i.e.). 

6 1 x 
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Case 2: i is stable . 

If i reaches a stable position on the queue, then pop(i) must also 
stabilize since it is set to only by a step (D) execution, at which 
time i is moved to the bottom of the queue. 

Case 2a: pop(i) stable at . 

Pop(i) can be set to 1 by step (B) at only finitely many arguments, 
hence $ < i); (a.e.). Elements above i on the queue can only be moved 
finitely often by step (D), for otherwise i would be unstable. So for 
almost all arguments x in the domain of ty ' , 'Jr ' (x) is defined via step 
(D) for some j below i on the queue with pop(j) = 1. But then condition 
(2) of step (D) guarantees that $ . (x) <; ijr'(x). Hence $. < i|r'(a.e.)- 

Case 2b: popfj 1 ) stable at 1 . 

Consider any x such that i, the elements above i on the queue, and 
their pops- have stabilized at stage < x,0 > and all later stages. By 
case 2a we may assume x is sufficiently large that $ . (x) < min(\|r(x), i|r ' (x) ) 
for those (finitely many) j which are above i on the queue with pop(j) = 0. Let 

m = max f $ . (x) | j is above i on queue and pop(j) = 0}. 

We observe that m <; min[i|r(x), ^ ' (x) ] , and thus if m is infinite, both 

i|f(x), i|r'(x) are undefined, implying by convention that $ . (x) < \|r (x) , 

§ i (x) < i|f ' (x) . So suppose m is finite. Since the pairing function is 

monotone in its second argument, < x,m > is the earliest stage at which 

f'(x) could be defined without violating condition (3) of step (D) and our 

assumption that the queue above i has stabilized. But i has stabilized as 

well, and so i must fail to satisfy condition (2) of step (D) at stage 

< x,m >. That is, $ . (x) <. m, and we therefore have $ . (x) < m ^ min (t|r (x) , \Jf ' (x) ) . 



1 
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Combining cases we have § . (x) <: \|;(x) (a.e.) » i is stable « 
(x) <: if'(x) (a.e.)- 



Corollary . There exists an honesty procedure onfi.. 

Proof. Immediate from section two and the fact that the procedure of 
Theorem 2 preserves F-classes as well as ^-classes. 

4. Large Honest Bounds on Computation 

Given a recursive function t we can think of t as a name for the 
class of functions 3>(t). Now in a sense we have understood a complexity 
class if we know how to compute its name, t. It follows that more easily 
computed functions (i.e. functions which can be computed rapidly) are 
more satisfactory names for a given class than long-running functions. 
Honest functions seem to be good candidates for names, then, because they 
are only as hard to compute as they are large. We now show that in general 
honest functions are not necessarily satisfactory names in the sense 
described above. Indeed we exhibit an honesty procedure on R 1 which takes 
any recursive class name to an honest recursive name for the same class which 
is arbitrarily large (and therefore arbitrarily long-running) on all but 
a rapidly vanishing percentage of arguments. Furthermore we prove that any 
honesty procedure on P 1 must (almost) have this property. We remark that 
this phenomenon is closely related to the gap theorem mentioned in the 
introduction; in both cases we pass from a recursive function t to a much 
larger recursive function t' while preserving class size. 
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Theorem 3 . There is an honesty procedure s, on P-, such that for every e 



lim |{y £ x I y € domain (<p )} | 

x-te. SISi — -* 0. 



Proof of the Theorem . The procedure of the theorem is only a slight 
variant of the procedure of Theorem 2. As before i|r' is defined in stages 
beginning with stage 0. A function "pop" from integers to integers is 
defined and updated during successive stages. Clause (D) has the added 
restriction that when pop(i) is larger than x, i is excluded from the 
priority scheme of the queue at arguments ^ x. The pop function is sufficiently 
fast-growing to insure that only a small fraction of the entries on the 
queue can be used to define i|f' at arguments £ x. H«nce at "most" arguments 
S x, f will be undefined. 

A) Put n on the bottom of the queue, (i.e. set q = n) ; set 

n 

pop(n) = 2 . Set x = TT..(n), y = TT_(n). 

B) If § (x) = y, then for each i, £ 1 £ n, if fpop(i) = and 

e 

* (x) > f(x)] set pop(i) = 2 n . 

C) If i|r'(x) has been defined previously go to stage -n+1. 

D) Find the least i £ n (if any) such that 

1) < pop(i) < x 

2) $ (x) > y, and 

q i 

3) (Vj < i)(pop(j) - '-» * (x) £ y) 
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If such an i exists, set pop(q.) = and move q. to 

the bottom of the queue. Go to stage n+1. If no such 

i exists, go to stage n+1. rn 

We omit the proof that our procedure is indeed an honesty procedure 
on P x ; the proof here is virtually identical with that given in Theorem 2, 
We prove the limit condition of the lemma. Given any x, step (A) 
guarantees that at any stage n = < y,z > where y £ x, at most log 2 (x) 
indices on the queue can have pops which might be used in step (D) 
condition (1) to define i|r'(y). Furthermore, if i is such an index and if 
i is used again at stage n = < y,z >, y s x , to define i|r ' (y) , then if it 
is to be used again at some later stage to define ijr ' (w) for some other 

TT+1 

w <: x, its pop will be at least 2 . Hence i can be used to define at 
most riog 2 (x)-i](the greatest integer in (log 2 (x)-i)) arguments y <; x. 
Thus i|f'(x) can be defined on at most 

flog 2 x] 
Y [log 2 (x)-j] 

arguments ^ x. So 

[log 2 (x)] 

i, . i A [ lo g 9 (x)-j] 

| {y < x | y e domain^)} [ j^D l _ 

x x ; 

but the right hand expression goes to in the limit, proving the 
theorem. p 
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Theorem 3 leads naturally to the following result about honesty 
procedures on ft.. 

Theorem 4 . There is an honesty procedure on ft., such that given any 

t 6 ft, and any b € ft,, there exists an e, cp = t, such that 
l 1 e 

lim |{y ** K(e) (y) <b ^) l _ Q 

Proof . Let s be the honesty procedure on P 1 described in Theorem 3. 

Recall that we can make s into an honesty procedure on ft, by defining 

cp s ,, e v(x) = min[cp , . (x) , (cp (x) + $ (x))]. Let t be any recursive 

function. Blum [1] shows that every recursive function has arbitrarily 

bad (i.e. arbitrarily long running) programs. That is, we can choose 

cp = t such that § (x) > b(x) for all x. Hence given t and b, choose 

such an e, cp = t, and then cp ,, „ satisfied the theorem. □ 

e ^s 1 (e) 

The following theorem describes the behavior of any honesty procedure 

on P, . 

Theorem 5 . Let s be any honesty procedure on P- and let t and b be 

any recursive functions. Then there is a cp = t such that 

e 



lim inf 
x-*» 



l {y * x ' <*v e ^ y) <b <y>}l 



* 

Bass and Young [7] prove a somewhat weaker form of this theorem: they show 
that an e can be found such that cp , * will be larger than b with 
recursive frequency. s ^ e ' 
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Proof . Define using the recursion theorem a program © such that 

( t(x) if r(x = 0) or (x > andcp (x-1) 
convergent) ] and 3z > x such that 

l( y ^ g I gp s(e) (y) < b (y)) l i 

z X+l 

co otherwise. 



Cp (x) = 
e 



Clearly, if cp is total, then cp = t. Suppose CD is not total, and let 
e e e 

x be the least y such that cd (y) diverges. Then cp (z) diverges for all 

e e 

z s x, but since cp e (x-l) converges, the first clause in the definition 

of cp (x) implies that for all z > x 
e 

If y * z i <p s(e) (y) < My)) I x 

Z x+1" 

In particular, domain (cp , . ) must be infinite. However, it is easy 

to show that if i|; 6 P, has infinite domain, then ? (\|r) 4- P • Hence 

1 P 1 

& (<P , .) ^P, = ^ (cp ), contradicting the fact that s is an honesty 
ps^ej x pe 

procedure on P.. Therefore, © = t. 
1 e 

Now for each x let z be the least z > x for which the second conjunct 

in the definition of cp holds. Then {z } is a subsequence of the 

e X i=0 

integers for which 

l (y*« x U s(e) (y) <My)) l 

lim * — L -» 

X-teo x 

and the theorem is proved. D 
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We remark that the "lim inf" appearing in Theorem 5 cannot be 
replaced by "lim". We sketch breifly why this is so. Let s be the 
honesty procedure on P< of Theorem 2, and let t be any g-honest recursive 
function. We construct an honesty procedure s on P.. in the following 
manner. Given index e, begin constructing. qo . . as prescribed in the 
theorem. If at some stage n it is discovered that <p has converged on 
a new initial segment, see if <p = t on that initial segment. If so 
find the least x such that stage < x,0 > has not yet been reached and 
define qo /.x(z) = t(z) f or x <: z <: 2x. It is not hard to show that s 

°x.\ e / t 

is a legitimate honesty procedure on P. , and furthermore for any qo = t 

1 e 

' {y * X I ^s (e) (y) < t(y) }' 

lim sup £ -. 

x-*» x 2 

In particular not all honesty procedures on P, satisfy Theorem 3. 

5. Good Honest Names for Complexity Classes 

In this section we consider honesty procedures that work for total 
functions only. We show that by relaxing the requirements on .honesty 
procedures in this way, we can indeed build well-behaved honest bounds 
for complexity classes which often significantly improve on the original 
bound for the class. We first build an honesty procedure yielding 
honest bounds which are no larger than the original class bound on a 
significant percentage of arguments. Next we show how to keep honest 
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bounds for 3?(t) bounded (a.e.) in a manner independent of the program 
we choose for t. Lastly we exhibit an honesty procedure on ft- which 
preserves monotonicity. 

Implicit in the work of Constable [11] is the observation that there 
are complexity classes all of whose honest names are much larger (i.o.) 
than some dishonest name. Indeed any class ?(t) where t is obtained 
via the gap theorem has this property. Theorem 6 shows that this result 
is false if we replace "(i.o.)" with "(a.e.)". 

Theorem 6 . There is an honesty procedure onR,, s , such that if m 

1 e 

is total, then 

lim inf ^±£2 § = Q ^ 

n-fc» 

Proof of the Theorem . The proof follows the general outline of Theorem 2. 

In the course of the procedure we define a "percentage" function P(n) 

which monitors the frequency with which cp , , is small. In addition the 

s(e) 

pop function in this proof is 0-1-2 valued. Here pop(i) = 2 means that 

^(e) has been defined to be !ess than $., but movement of i to the bottom 
of the qneue has been delayed. 

Stage n : 

Let n 1 (n) = x, TT 2 (n) = y. 

A) Set q = n, and set pop(n) = 1. 
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B) If $ (x) = y, then for <; i £ n, if § (x) > cp (x) and pop(i) = 0, 

e i g 

set pop(i) = 1. 

C) If i|r'(x) has been defined at some previous stage, go to stage n+1. 

D) Find least i £ n, if any, such that 
X) pop( qi ) = 1 or 2 

2) 3 q (x) > y 

3) (Vj < i)[pop( qi ) = -► $ (x) £ y] 

J 

If such an i exists, set i|f'(x) = y, and set pop(q t ) = 2. 

* 
E ) See if 3w £ n such that w > P(n) and 



!(».*» 1 qP s(e ) (z) ^q° e (z > and $ 8 (e) (a)> $ e (z) * n} ' 



w P(n) 

If such a w exists, set all 2's on queue to 0, and move them to 
the bottom of the queue. Set P(n+1) = P(n) + 1. Go to next stage. 
If no such w exists, set P(n+1) = P(n) , and go to next stage. □ 

As in the proof of theorem 2, there is an r € R, such that the procedure 
yields, for ever e, a function cp , ■> = ♦'.. Furthermore, fowevl-egj^ ia 
a measured set. Define 

t( x ) =<p s(e) 00 = si£[<p r(e) ( x )» <P e ( x > + * e ( x M; 

then (cp / \) cR is a measured set, and s is the desired procedure. 



Clause <£) involves an implicit use of the recursion theorem. 
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To prove the limit condition of the theorem, we need to show that 

Clause (E) is executed infinitely often for recursive t = © • Suppose 

therefore that (E) is executed only finitely often, and let < x,0 > be 

a stage after which there are no Clause (E) executions. We can assume 

without loss of generality that by stage < x,0 > all pop entries on the 

queue which are ever set to 1 have been set to 1, and furthermore < x,0 > 

is large enough that an index for the empty function appears on the queue 

(its pop at stage < x,0 > must be 1 or 2). Then for all z > x and all 

i such that pop(i) = 0, § (z) s t(z), and so clause (D) and the presence 

of an index for the empty function on the queue guarantees that i|r'(z) will 

be defined and i|r'(z) <: t(z). Therefore the percentage of arguments where 

i|f'(z) £ t(z) will eventually move above 1- — — — , and at that time, 

P(< x,0 >) ' ' 

clause (E) will get executed. 

To show that ?(qp ) = %(cp , .) in the case where cp SB., notice that 
•= s (,ej el 

if i stabilizes on the queue, its pop cannot be 2. Using this observation 
it is easy to show that the classes are the same by using the techniques 
developed in theorem 2, and we omit the proof. 

Our next theorem illustrates the striking difference between honesty 
procedures on 5^ and honesty procedures on P . Theorem 5 says that given 
any t € S^, every procedure on P. must map some program for t to an 
arbitrarily large honest name for ^(t). We now construct a procedure on 
fc 1 which produces uniformly bounded honest names for ^(t) independent 
of the program chosen for t. The procedure of Theorem 7 is an example of 
an honesty procedure on S? which cannot be extended to an honesty procedure 



on P.. . 
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Theorem 7 < There is an honesty procedure oitR., s, with the property 

that for every recursive t, there is a b € €, such that if cp = t, 

1 ^e 

then © . . £ b (a.e.). 
^s(e) 

Proof . Let s' be any honesty procedure on ft. with the property that if 

cp is total, then F(cp ) = F(cp ). Say that® = cp , if after n steps 
" e s \ g) e e 

of the dovetailed computation of cp and cp , , cp and cp , have not differed 
on any argument. Define 

<P 8 <e) (x) = SiSfcVce) 00 ' V 00 + $ e' (x) ' e ' * e ' V "^e 1 ' (#) 

{qD s(e) } e€A iS a WBaamed set since both {<P 8 ,( e )W . «* («P e + Ve€# 
are measured. Furthermore F(cp . .) = F(cp ). Suppose §.:£ cp (a.e.)- Then 
for sufficiently large x those e* s e which compute functions which differ 

from e will be omitted from the expression £) for cp , v. From then on if 

s (e) 

cp e ,(y) converges for any e 1 £ e,..tp , (y) will equal cp (y) . Therefore since 



* ± ^ <P g i / e v (a.e.), $ ^ <P ;g / € ).(*•«•)• If on the other hand $ > cp (i.o.), 

then? > cp (i.o.), and since cp ,, s ^ <P t \ everywhere, $. > cp , .(i.o.), 

i s (e) s'(e) ^a(e) ' ' i s(e) v 

Let e' be the least index for cp € ft,. Then for every cp = co , 

el i ■ e 

^s(i) *V + V (a ' e °- D 

Our last theorem shows that every class with a monotone name has a 

monotone honest name, settling a question raised in f4]. 

Theorem 8 . There is a g € ft such that for every monotone recursive 

t ^ \x[x] there is a g-honest monotone recursive t' such that 3?(t) = 3?(t'). 
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Proof. Our construction will again follow the lines of Theorem 2. However, 

t' will be total and monotone whenever t is total, and so ^(t) may differ 

from ?(t') in the case where t is not monotone. Define CD /IS (x) = max[$ (z) ,x 

CT(1) zSx ■ *" 
^ CD cr(i)-' i£M 1S S measured set « Moreover for monotone t > \xfx] we have that 

$ <: t (a.e.) o <p < t (a.e.). Let t = cp . 
i cr(i) v e 

Stage n . Let TT-(n) = x, rr (n) = y 

A) Set q = n; set pop(q ) = 1 

B) If § g (x) = y, then for <, i < n if CD , . . (x) > t(x), set pop(i) = 1. 

C) If t'(x) has already been defined at some previous stage, go to 
stage n+1; if 3z < x such that t'(z) > y, go to stage n+1; if x < y, 
go to stage n+1. 

D) Find least i £ n (if any) such that 

1) pop( qi ) = 1 

2) m cr(q.) (x) >y 

3) (Vj < i)[pop(q.) = ->cp ,(x) <; y] 

If i exists, set t'(x) = y, set pop(q.) = 0, and move q. to 
the bottom of the queue. 

E) If (D), find greatest z < x such that t' (z) has already been defined; 
set t'(w) = y for z < w < x. Go to stage n+1. □ 

The procedure yields, for each e, a partial functioned , v . Moreover 

s(e) 

^s(e)^eel^l iS a measured set: to test cp (x) = y, merely run the pro- 
cedure through the first < x,y > stages and check to see if cp , x (x) is 

s(e) v 

defined to be y at one of these stages. Clause (C) guarantees that m . . (x) 

s(e) 

can never be set equal to y after stage < y,y >. 
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If t is total, then t' will be total and monotone by clause (C) and 

the fact that Clause (D) must be executed infinitely often. If t > Xx[x], 

then pop stability analysis and the fact that each cp,^ is monotone shows 

that for every i, cp ... ^ t (a.e.) » cp . . . ^ t' (a.e.). But then for 
J ' ct(i) ct (i) 

monotone t we have 

$. < t (a.e.) < cp ,.. s t a.e. » cp ,.. ^ t' (a.e.) 

o §. < t 1 (a.e.) , r_l 

Corollary . There is an honesty procedure on R , s , such that for every 

recursive monotone t s \x[x], if CD = t then© * is monotone. 

L ' e s (e) 

Proof . Let s be the procedure of Theorem 7, and let s' be any honesty 

procedure on^. Define s as follows: 

m ., . (x) if, within x steps it is discovered 
s' (e) 

that cp is not monotone, or within x 

Let cp ■>-, v (x) = { steps it is discovered that cp < kx[x]; 

s"(e) s I e 

cp . . (x) otherwise. 
s(e) 

The first clause on the right is obviously recursive, and so s € R^. 
If cp > \x[x] and is monotone, then cp *, . = cp , . ■ Otherwise <P s */ e \ = 

Co , . . (a.e.). Hence s is the desired honesty procedure on ft... 
s'(e) L 

We remark that the lower bound \x[x] of the theorem and the corollary 
may be replaced by any slow-growing unbounded function. Borodin \2] shows 
that some lower bound is necessary, and thus our result is best possible. 



10. 



12. 
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Chapter 3 

An Operator Embedding Theorem for Complexity Classes of Recursive 
Functions 

1. INTRODUCTION 

Let ?(t) be the set of functions computable by some machine using 

no more than t(x) machine steps on all but finitely many arguments x. 

If we order the £- classes under set inclusion as t varies over the 

recursive functions, then it is natural to ask how rich a structure 

is obtained. We show that this structure is very rich indeed. If R 

is any countable partial order and F is any total effective operator, 

then we show that there is a recursively enumerable sequence of 

recursive machine running times (? „.},_, such that if iRk, then 

s(k; ktN 

y Q! ($ s (j))) ^ f (* g(k) ). and if j and k are incomparable, then F(§ ) < 

*sfk} ° n infinltel y many arguments, and F(i ., , ) < $ /mS on infinitely 
"^' ~ s(k) s(j) J 

many arguments. 

An interesting feature of our proof is that we avoid appealing 
explicitly to the continuity of total effective operators; indeed our 
proof follows directly from a single appeal to the recursion theorem. 

Several investigators have considered this and related problems, and 
in Section 4 we briefly summarize these investigations and compare them 
to our own. 
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2. PRELIMINARIES 

For notation from recursive function theory we follow Rogers [2 ]. 

For each n € N, P n stands for the partial recursive functions of 
n-variables, and ffi^ stands for the total recursive functions of n 
variables. 

We use (a.e.) to denote "almost everywhere", which for our 
purposes stands for "all but finitely many". Similarly (i.o.) stands 
for "infinitely often". 

Suppose {(D ,CP 1 ,...} is a Godel numbering of P.. A measure on 
Computation [1] $ = [t Qt i^ t ...) is a sequence of functions in P- 
satisfying 

1. Vi € N [domfo .) = dom(ff'.)'] 

2. \ixy[$ i (x) = y] is a recursive predicate. 

If we think of our Godel numbering in the usual one-tape Turing machine 
formalism, then 

9 ± (x) = "the number of steps in the computation of the i Turing 
machine on argument x" is a measure on computation. 

Henceforth let § be some fixed measure on computation. Then we 
define for any total function t 



and 



F(t) = {i 6 N | cd ± £ ft, and f * t (a.e.)}, 



?(t) = ^i I i € F(t)} 
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That is, F(t) is the set of (indices of ) total machines which run 
in time t, and g?(t) is the set of total functions computable within 
time t. 3?(t) is called a complexity class . 

A sequence of partial functions ¥ = f^,^,...] is said to be 
an r.e. sequence of partial functions if \ix [i|; . (x) ] £ P . 

The following theorem of Blum [ 1 ] shows that we can uniformly 
enlarge complexity classes <?(t) if t is a sufficiently well-behaved 
function. 

Theorem . (Compression Theorem) There is a g ^ 2 such that for every 
$ . € R v ?($.)^ 5(\xg(x,* i (x)). g is called a compression function 
for §. 

An operator is a map which takes functions to functions; we 
write F(f)(x) to mean the value of the operator F applied to the 

function f, evaluated at x. An operator F: D £ p, ■> P 1 is ca lled an 

~ ll 

effective operator if there is an s € R 1 such that F(co ) (x) = © (x) . 

~ g s (e) 

An effective operator F is total effective if for every f £ R . , 
F(f) is defined and F(f) £ ft . 

3. THE EMBEDDING THEOREM 

Theorem. Let F be any total effective operator, and let R be any recursive 
countable partial order on N. Then there exists an r.e. sequence of 
recursive functions ?Q , p^ ... p ^ ... such that if jRkj then F(p.) < 

P k (a.e.), and if j and k are incomparable, then F(p.) < p (i.o.), and 

~ J k 

p. < F(p ) (i.o.). 

K ~ j 
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Proof. We assume without loss of generality that R orders N-{0} 
rather than N, and in addition that R contains kRO for each k > 0. 
Let i Q = < i Q » k Q >, aj_ = < i 1 , ^ > , , . . i a = < i , k >, ... be. a 
recursive listing of all incomparable pairs in R such that if x and 
y are incomparable, then < x, y > and < y x > both appear infinitely 
often in the list. As a technical convience we define max [<t> ] = 0. 
Let s € R_ b e the s. function of the s-m-n theorem defined by the 
equation 



CD e «x, y» -ffl 8(e(X) (7). 



Define i|r € P ? as follows: 



/ if x < k or 3n < 



k such that $ (< 0, n >) > x, (1) 



*g [<D .(e, J )W + ^.(e.j) )W1) + 

jRk 



(2)(i) 



[m 



(e.i)« + Ito 8(efl) )(x)]. 
n n 



(2)(ii) 



\|r(e, <k,x >) = 



where n = Mnis:x[((m = 0) and (x = k )) or 

[(m > 0) and (k = k ) and [(?i (Oils m)) 
m ^^~ 



(3z. < x) such that (z„ = k.) and 
l 

(«,.- = z. +9 . v(z,)) and (z = x) ] ] ] , if 
i+1 i s(e,k ) v i." v m ' ' 

such an n exists and (1) is not true, and 



max [o ..(x) +F(co . ..)(x)] otherwise. 

— s(e,j) ~ w s(e,j)' v 

jRk 



(3) 
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ljr € P 2 since all the test computations in clauses (1) and (2) are 

recursive by the second measure on computation axiom. By the recursion 

theorem there is an e such that i[r(e, <k,x >) =co e (<k,x»; we apply the 

s-1-1 version of the s-m-n theorem to obtain i|r(e, <k,x>) =© (x) 

s(e,k) 

To simplify our notation we now suppress mention of e and write p (x) = 

K. 

^sCe.k)^- Similarl Y we write § (x) for § (x) . Our definition 

"\r s(e,K,) 

now becomes 



\w 



r • * 



f x < k or 3n < k such that $ (n) < x, 



rnax[ p (x) + F( p .)(x)]) + 

j^x J ~ J 

IRk 



[P., (x) + F(p. )(x)], 



(1) 

(2)(i) 

(2)(ii) 



where n = M m < x[((m = 0) and (x ==. k ) ) or 

[(m > 0) and (k = k ) and [(Vi(0 <: i < m))(3z <; x) 

m ± 

such that (z = k ) and (z = z. + $ ( Z J) and 
u u i+l i p, i 

& . 

i 
( z m = x)]]], if such an n exists and (1) is not 

true, and 



IB 3 * [p . (x) + F( p . ) (x) ] otherwise. 

jRk 

We first establish that at most finitely many of the functions 
^ P k^k€N Can be non - total - Suppose P k (x) diverges. Since p is defined 
by (3) at all arguments, P Q (x) must diverge, and so by (1) p . (x) = 
for all j > x> 



(3) 
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We now prove that for all k p fe is total. 

Say that a R is serviced at x if Pfe ( x ) is defined by (2), and if 
n is the least m * x satisfying the body of (2) in the definition of 
^(x). We allow the possibility that P^x) may diverge. If a n is 

serviced at x, (2) guarantees that x - 2 "jtf - + , ( }> "^ SQ 

i=l * P k- i 

a n is serviced at no other argument. Moreover, if a n is'serviced at x 
and p k Jx) diverges, then for n' > n a^ will never be serviced, since 

V is serviced at y only when y bounds the computation of $ ( x ) 

\ 
Let k be an R-minimal element in the finite set { k' | Pfcl non-total) 

Then if p fc (x) diverges, it must do so because of (2)(ii). That is, a 

is serviced at x for some n, and p ± must be non-total. 

n 
But suppose p^(y) diverges by an instance of (2) (ii) f or aome y . 

This means that i n ? kj for some j and flj is serviced at y. if j < n> 

then y must equal Zj , but since * n is serviced x, • (. J < x and hence 

Pi. j 

J 
P k (.j) must converge. If j > „, then since a is serviced at x and 

J n 

P k (x) is assumed to diverge, ^ is never serviced. Moreover j cannot 

equal n, for then i n would equal k^ Hence p must be non-total because 

-a 
of (2)(i) or (3), and so some funetion p^ such tktt i^ i8 non-total. 
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Let i be R minimal among {i' [ i'R i and i 1 non- total} . Then 



n 



p^ must be non-total by an instance of (2)(ii), say at argument y. 
Hence i = k. for some j, and a. must be serviced at y = S z; + 

$ ( z )• If J < n > Pi (y) must converge since a is serviced at x 
Pi, m k . n 

K J 

by assumption; and if j = n, then i and k are comparable, a contra- 

n n t- , 

diction. Furthermore if j > n, then a. will never be serviced. Hence 

p^ is total, and we conclude that for every k p € R . 

If jRk, then F(p.)(z) <: p (z) for all z > m n = max[k,j,§ (0), 
~ J k Pq 

* (1), ... S (k-1)]. 

p o p 

If j and k are incomparable, then < i,k > = k , a , ... a , ... 

n n n 
1 q 

for some infinite sequence n_ < n n < n„ • • • n ••• . 

12 q 

For arguments z > m Q P fc (z) is defined by (2) or (3). Since the 
sequence of z^s is strictly increasing, there is an i such that for 
1 > i 0' Z i ^ m 0' At those arguments z for i > i , i = n , p (z.) will 
be defined by clause (2) and p (z. ) > F(p . ) (z. ) . A symmetric argument 

K 1 j i 

shows that p. > F(j» )(i.o.), and the theorem is proved. 

Corollary . Let F be any total effective operator, and let R be any 
countable partial order on N. Then there exists an r.e. sequence of 
recursive measure functions $ r(Q y $ r m' ••■ such that if J Rk > then 
F(§ rQ) )< f r(k) (a.e.) and y (F(* r(j) ) £ ^ § r (k) )5 and ±f j and k are 

incomparable, then F($ ) <$ (i.o.), and F($ „ . ) <§ ,. s (i.o.). 

r U; r(K) ~ r(k) r(j) 
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Proof . Mostowski [ 3 ] has shown that there is a countable partial 

* 
order R into which any countable partial order may be embedded. 

* 
Moreover, Sacks [ 4 ] has shown that R is recursive. 

We assume without loss of generality that F is at least as large 
as the identity operator, and that the compression function for $, g, 
is strictly increasing in its second argument. Blum [ 1 ] has shown 
that there is an h € R 2 sucl1 that for a11 * <P.f ( x ) ^ ^(x, § . (x)) (a.e. ) . 
assume that h is strictly increasing in its second argument. To prove 
the corollary, apply the theorem to R , rewrite clause (2) as 

max [ p ( x >fh(x,,g(x,F($ X*»)]'+T» f (x) + h(x,g(x,F(S )(x)))], 
jRk n 

and we rewrite clause (3) as 



max[p,(x) +h(x,g(x,F(f )(x)))]. 
jRk 



It is easy to see that the theorem goes through as before, and the 

monotonicity restrictions on g and h guarantee that the- functions 

{$ )]rcya safc isfy the corollary, 
■k ■"■■ 



We 
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4 . RELATION TO OTHER WORK, AND OPEN PROBLEMS 

McCreight [5] is the first investigator to prove an embedding 
theorem for subrecursive classes. He shows that any countable partial 
order can be embedded in the complexity classes ordered under set 
inclusion. However, his theorem is weaker than our results in that 
the functions of his partial order are "separated" by composition 
with a fixed recursive function, whereas our functions are separated 
by a total effective operator. In [6] Enderton also proves a universal 
embedding theorem for subrecursive classes. His notion of a sub- 
recursive class is quite weak, however, and his result is an immediate 
corollary of McCreight 's theorem. 

Early work on the structure of subrecursive classes was done by 
Feferman [12], Meyer and Ritchie [7], and Basu [8]. Feferman shows 
that dense chains exist for various notions of subrecursive classes. 
Meyer and Ritchie define what they call elementary honest classes, and 
they show the existence of dense chains and infinite anti-chains for 
such classes. Moreover, they are able to exhibit certain functions f 

such that dense chains of classes will exist between f and the iterate 

( x ) 
of f, \x[f (x) ] . Basu builds dense chains of subrecursive classes, where 

these classes are closed under the application of a fixed recursive operator. 

Machtey [11] has announced universal embedding theorems for both 

the "honest" primitive recursive degrees and the "dishonest" primitive 

recursive degrees. Both of these theorems follow immediately from our 

results. 
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We also note that Alton [ 9 ] has independently announced our 
embedding theorem. 

We leave open the question of the slse of the functions in our 
embedding theorem. That is, given F, what is a reasonable upper bound 
on the sire of p in terms of F(recall that p bounds all the functions 
{P k ) keN on all arguments). 

The author wishes to acknowledge the generous assistance of Professor 
Albert R. Meyer in the conception and preparation of this paper. 
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